Aug 14 21:40:45 user nova-compute[73144]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 21:40:48 user nova-compute[73144]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73144) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73144) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73144) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 21:40:48 user nova-compute[73144]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:40:48 user nova-compute[73144]: INFO nova.virt.driver [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 21:40:48 user nova-compute[73144]: INFO nova.compute.provider_config [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Acquiring lock "singleton_lock" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Acquired lock "singleton_lock" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Releasing lock "singleton_lock" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Full set of CONF: {{(pid=73144) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ******************************************************************************** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Configuration options gathered from: {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ================================================================================ {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] allow_resize_to_same_host      = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] arq_binding_timeout            = 300 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] backdoor_port                  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] backdoor_socket                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] block_device_allocate_retries  = 300 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] block_device_allocate_retries_interval = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cert                           = self.pem {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute_monitors               = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] config_dir                     = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] config_drive_format            = iso9660 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] config_source                  = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] console_host                   = user {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] control_exchange               = nova {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cpu_allocation_ratio           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] daemon                         = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] debug                          = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] default_access_ip_network_name = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] default_availability_zone      = nova {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] default_ephemeral_format       = ext4 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] default_schedule_zone          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] disk_allocation_ratio          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] enable_new_services            = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] enabled_ssl_apis               = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] flat_injected                  = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] force_config_drive             = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] force_raw_images               = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] graceful_shutdown_timeout      = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] heal_instance_info_cache_interval = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] host                           = user {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instance_build_timeout         = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instance_delete_interval       = 300 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instance_name_template         = instance-%08x {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instance_usage_audit           = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instance_usage_audit_period    = month {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] internal_service_availability_zone = internal {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] key                            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] live_migration_retry_count     = 30 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_config_append              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_dir                        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_file                       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_options                    = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_rotate_interval            = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_rotate_interval_type       = days {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] log_rotation_type              = none {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] long_rpc_timeout               = 1800 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] max_concurrent_builds          = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] max_concurrent_live_migrations = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] max_concurrent_snapshots       = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] max_local_block_devices        = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] max_logfile_count              = 30 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] max_logfile_size_mb            = 200 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] maximum_instance_delete_attempts = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] metadata_listen                = 0.0.0.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] metadata_listen_port           = 8775 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] metadata_workers               = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] migrate_max_retries            = -1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] mkisofs_cmd                    = genisoimage {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] my_ip                          = 10.0.0.210 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] network_allocate_retries       = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] osapi_compute_listen_port      = 8774 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] osapi_compute_unique_server_name_scope =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] osapi_compute_workers          = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] password_length                = 12 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] periodic_enable                = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] periodic_fuzzy_delay           = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] pointer_model                  = ps2mouse {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] preallocate_images             = none {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] publish_errors                 = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] pybasedir                      = /opt/stack/nova {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ram_allocation_ratio           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rate_limit_burst               = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rate_limit_except_level        = CRITICAL {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rate_limit_interval            = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] reboot_timeout                 = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] reclaim_instance_interval      = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] record                         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] reimage_timeout_per_gb         = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] report_interval                = 120 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rescue_timeout                 = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] reserved_host_cpus             = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] reserved_host_disk_mb          = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] reserved_host_memory_mb        = 512 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] reserved_huge_pages            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] resize_confirm_window          = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] resize_fs_using_block_device   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] resume_guests_state_on_host_boot = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rpc_response_timeout           = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] run_external_periodic_tasks    = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] running_deleted_instance_action = reap {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] running_deleted_instance_timeout = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler_instance_sync_interval = 120 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_down_time              = 720 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] servicegroup_driver            = db {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] shelved_offload_time           = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] shelved_poll_interval          = 3600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] shutdown_timeout               = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] source_is_ipv6                 = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ssl_only                       = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] state_path                     = /opt/stack/data/nova {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] sync_power_state_interval      = 600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] sync_power_state_pool_size     = 1000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] syslog_log_facility            = LOG_USER {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] tempdir                        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] timeout_nbd                    = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] transport_url                  = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] update_resources_interval      = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] use_cow_images                 = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] use_eventlog                   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] use_journal                    = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] use_json                       = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] use_rootwrap_daemon            = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] use_stderr                     = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] use_syslog                     = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vcpu_pin_set                   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plugging_is_fatal          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plugging_timeout           = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] virt_mkfs                      = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] volume_usage_poll_interval     = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] watch_log_file                 = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] web                            = /usr/share/spice-html5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_concurrency.disable_process_locking = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.auth_strategy              = keystone {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.compute_link_prefix        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.dhcp_domain                = novalocal {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.enable_instance_password   = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.glance_link_prefix         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.instance_list_per_project_cells = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.list_records_by_skipping_down_cells = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.local_metadata_per_cell    = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.max_limit                  = 1000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.metadata_cache_expiration  = 15 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.neutron_default_tenant_id  = default {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.use_forwarded_for          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.use_neutron_default_nets   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.vendordata_dynamic_targets = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.vendordata_jsonfile_path   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.backend_argument         = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.config_prefix            = cache.oslo {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.dead_timeout             = 60.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.debug_cache_backend      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.enable_retry_client      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.enable_socket_keepalive  = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.enabled                  = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.expiration_time          = 600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.hashclient_retry_attempts = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_dead_retry      = 300 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_password        =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_sasl_enabled    = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.memcache_username        =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.proxies                  = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.retry_attempts           = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.retry_delay              = 0.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.socket_keepalive_count   = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.socket_keepalive_idle    = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.socket_keepalive_interval = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.tls_allowed_ciphers      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.tls_cafile               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.tls_certfile             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.tls_enabled              = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cache.tls_keyfile              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.auth_section            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.auth_type               = password {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.cafile                  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.certfile                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.collect_timing          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.cross_az_attach         = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.debug                   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.endpoint_template       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.http_retries            = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.insecure                = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.keyfile                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.os_region_name          = RegionOne {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.split_loggers           = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cinder.timeout                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.cpu_dedicated_set      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.cpu_shared_set         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.image_type_exclude_list = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.resource_provider_association_refresh = 300 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.shutdown_retry_interval = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] conductor.workers              = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] console.allowed_origins        = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] console.ssl_ciphers            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] console.ssl_minimum_version    = default {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] consoleauth.token_ttl          = 600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.cafile                  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.certfile                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.collect_timing          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.connect_retries         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.connect_retry_delay     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.endpoint_override       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.insecure                = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.keyfile                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.max_version             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.min_version             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.region_name             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.service_name            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.service_type            = accelerator {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.split_loggers           = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.status_code_retries     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.status_code_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.timeout                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] cyborg.version                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.backend               = sqlalchemy {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.connection            = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.connection_debug      = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.connection_parameters =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.connection_recycle_time = 3600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.connection_trace      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.db_inc_retry_interval = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.db_max_retries        = 20 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.db_max_retry_interval = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.db_retry_interval     = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.max_overflow          = 50 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.max_pool_size         = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.max_retries           = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.mysql_enable_ndb      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.mysql_wsrep_sync_wait = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.pool_timeout          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.retry_interval        = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.slave_connection      = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:48 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] database.sqlite_synchronous    = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.backend           = sqlalchemy {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.connection        = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.connection_debug  = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.connection_parameters =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.connection_recycle_time = 3600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.connection_trace  = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.db_inc_retry_interval = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.db_max_retries    = 20 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.db_max_retry_interval = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.db_retry_interval = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.max_overflow      = 50 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.max_pool_size     = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.max_retries       = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.mysql_enable_ndb  = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.pool_timeout      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.retry_interval    = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.slave_connection  = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] api_database.sqlite_synchronous = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] devices.enabled_mdev_types     = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ephemeral_storage_encryption.enabled = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.api_servers             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.cafile                  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.certfile                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.collect_timing          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.connect_retries         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.connect_retry_delay     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.debug                   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.default_trusted_certificate_ids = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.enable_certificate_validation = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.enable_rbd_download     = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.endpoint_override       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.insecure                = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.keyfile                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.max_version             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.min_version             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.num_retries             = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.rbd_ceph_conf           =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.rbd_connect_timeout     = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.rbd_pool                =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.rbd_user                =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.region_name             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.service_name            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.service_type            = image {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.split_loggers           = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.status_code_retries     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.status_code_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.timeout                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.verify_glance_signatures = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] glance.version                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] guestfs.debug                  = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.config_drive_cdrom      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.config_drive_inject_password = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.enable_remotefx         = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.instances_path_share    =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.limit_cpu_features      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.use_multipath_io        = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.vswitch_name            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] mks.enabled                    = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] image_cache.manager_interval   = 2400 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] image_cache.precache_concurrency = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] image_cache.remove_unused_base_images = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] image_cache.subdirectory_name  = _base {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.api_max_retries         = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.api_retry_interval      = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.auth_section            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.auth_type               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.cafile                  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.certfile                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.collect_timing          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.connect_retries         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.connect_retry_delay     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.endpoint_override       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.insecure                = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.keyfile                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.max_version             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.min_version             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.partition_key           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.peer_list               = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.region_name             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.serial_console_state_timeout = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.service_name            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.service_type            = baremetal {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.split_loggers           = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.status_code_retries     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.status_code_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.timeout                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ironic.version                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] key_manager.fixed_key          = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.barbican_api_version  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.barbican_endpoint     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.barbican_endpoint_type = public {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.barbican_region_name  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.cafile                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.certfile              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.collect_timing        = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.insecure              = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.keyfile               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.number_of_retries     = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.retry_delay           = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.send_service_user_token = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.split_loggers         = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.timeout               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.verify_ssl            = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican.verify_ssl_path       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.auth_section = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.auth_type = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.cafile   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.certfile = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.collect_timing = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.insecure = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.keyfile  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.split_loggers = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] barbican_service_user.timeout  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.approle_role_id          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.approle_secret_id        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.cafile                   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.certfile                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.collect_timing           = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.insecure                 = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.keyfile                  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.kv_mountpoint            = secret {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.kv_version               = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.namespace                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.root_token_id            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.split_loggers            = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.ssl_ca_crt_file          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.timeout                  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.use_ssl                  = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.cafile                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.certfile              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.collect_timing        = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.connect_retries       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.connect_retry_delay   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.endpoint_override     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.insecure              = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.keyfile               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.max_version           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.min_version           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.region_name           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.service_name          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.service_type          = identity {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.split_loggers         = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.status_code_retries   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.status_code_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.timeout               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] keystone.version               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.connection_uri         =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.cpu_mode               = custom {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: WARNING oslo_config.cfg [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.cpu_power_governor_high = performance {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.cpu_power_management   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.device_detach_attempts = 8 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.device_detach_timeout  = 20 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.disk_cachemodes        = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.disk_prefix            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.enabled_perf_events    = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.file_backed_memory     = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.gid_maps               = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.hw_disk_discard        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.hw_machine_type        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.images_rbd_pool        = rbd {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.images_type            = default {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.images_volume_group    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.inject_key             = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.inject_partition       = -2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.inject_password        = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.iscsi_iface            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.iser_use_multipath     = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_downtime = 500 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_inbound_addr = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_scheme  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_timeout_action = abort {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_tunnelled = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: WARNING oslo_config.cfg [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 21:40:49 user nova-compute[73144]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 21:40:49 user nova-compute[73144]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 21:40:49 user nova-compute[73144]: and ``live_migration_inbound_addr`` respectively.
Aug 14 21:40:49 user nova-compute[73144]: ).  Its value may be silently ignored in the future.
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.live_migration_with_native_tls = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.max_queues             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.nfs_mount_options      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.num_pcie_ports         = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.pmem_namespaces        = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.quobyte_client_cfg     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rbd_secret_uuid        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rbd_user               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rescue_image_id        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rescue_kernel_id       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.rx_queue_size          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.smbfs_mount_options    =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.snapshot_compression   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.snapshot_image_format  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.sparse_logical_volumes = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.swtpm_enabled          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.swtpm_group            = tss {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.swtpm_user             = tss {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.sysinfo_serial         = unique {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.tb_cache_size          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.tx_queue_size          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.uid_maps               = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.use_virtio_for_bridges = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.virt_type              = kvm {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.volume_clear           = zero {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.volume_clear_size      = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.volume_use_multipath   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.vzstorage_cache_path   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.auth_section           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.auth_type              = password {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.cafile                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.certfile               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.collect_timing         = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.connect_retries        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.connect_retry_delay    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.default_floating_pool  = public {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.endpoint_override      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.extension_sync_interval = 600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.http_retries           = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.insecure               = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.keyfile                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.max_version            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.min_version            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.ovs_bridge             = br-int {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.physnets               = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.region_name            = RegionOne {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.service_metadata_proxy = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.service_name           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.service_type           = network {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.split_loggers          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.status_code_retries    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.status_code_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.timeout                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] neutron.version                = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] notifications.bdms_in_notifications = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] notifications.default_level    = INFO {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] notifications.notification_format = unversioned {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] notifications.notify_on_state_change = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] pci.alias                      = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] pci.device_spec                = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] pci.report_in_placement        = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.auth_section         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.auth_type            = password {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.cafile               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.certfile             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.collect_timing       = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.connect_retries      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.connect_retry_delay  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.default_domain_id    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.default_domain_name  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.domain_id            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.domain_name          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.endpoint_override    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.insecure             = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.keyfile              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.max_version          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.min_version          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.password             = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.project_domain_id    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.project_domain_name  = Default {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.project_id           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.project_name         = service {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.region_name          = RegionOne {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.service_name         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.service_type         = placement {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.split_loggers        = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.status_code_retries  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.status_code_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.system_scope         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.timeout              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.trust_id             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.user_domain_id       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.user_domain_name     = Default {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.user_id              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.username             = placement {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] placement.version              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.cores                    = 20 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.count_usage_from_placement = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.injected_file_content_bytes = 10240 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.injected_file_path_length = 255 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.injected_files           = 5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.instances                = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.key_pairs                = 100 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.metadata_items           = 128 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.ram                      = 51200 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.recheck_quota            = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.server_group_members     = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] quota.server_groups            = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rdp.enabled                    = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.image_metadata_prefilter = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.max_attempts         = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.max_placement_results = 1000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] scheduler.workers              = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.host_subset_size = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.isolated_hosts = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.isolated_images = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.pci_in_placement = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.track_instance_changes = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] metrics.required               = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] metrics.weight_multiplier      = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] metrics.weight_setting         = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] serial_console.enabled         = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] serial_console.port_range      = 10000:20000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] serial_console.serialproxy_port = 6083 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.auth_section      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.auth_type         = password {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.cafile            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.certfile          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.collect_timing    = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.insecure          = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.keyfile           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.send_service_user_token = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.split_loggers     = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] service_user.timeout           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.agent_enabled            = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.enabled                  = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.html5proxy_port          = 6082 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.image_compression        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.jpeg_compression         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.playback_compression     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.server_listen            = 127.0.0.1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.streaming_mode           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] spice.zlib_compression         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] upgrade_levels.baseapi         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] upgrade_levels.cert            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] upgrade_levels.compute         = auto {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] upgrade_levels.conductor       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] upgrade_levels.scheduler       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.cafile = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.certfile = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.insecure = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vendordata_dynamic_auth.timeout = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.api_retry_count         = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.ca_file                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.cache_prefix            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.cluster_name            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.connection_pool_size    = 10 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.console_delay_seconds   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.datastore_regex         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.host_ip                 = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.host_password           = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.host_port               = 443 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.host_username           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.insecure                = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.integration_bridge      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.maximum_objects         = 100 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.pbm_default_policy      = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.pbm_enabled             = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.pbm_wsdl_location       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.serial_port_proxy_uri   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.serial_port_service_uri = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.task_poll_interval      = 0.5 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.use_linked_clone        = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.vnc_keymap              = en-us {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.vnc_port                = 5900 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vmware.vnc_port_total          = 10000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.auth_schemes               = ['none'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.enabled                    = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.novncproxy_port            = 6080 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.vencrypt_ca_certs          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.vencrypt_client_cert       = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vnc.vencrypt_client_key        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.disable_rootwrap   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.enable_numa_live_migration = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.libvirt_disable_apic = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.client_socket_timeout     = 900 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.default_pool_size         = 1000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.keep_alive                = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.max_header_line           = 16384 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.ssl_ca_file               = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.ssl_cert_file             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.ssl_key_file              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.tcp_keepidle              = 600 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] zvm.ca_file                    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] zvm.cloud_connector_url        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] zvm.reachable_timeout          = 300 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.enforce_new_defaults = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.enforce_scope      = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.policy_default_rule = default {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.connection_string     = messaging:// {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.enabled               = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.es_doc_type           = notification {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.es_scroll_size        = 10000 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.es_scroll_time        = 2m {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.filter_error_trace    = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.hmac_keys             = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.sentinel_service_name = mymaster {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.socket_timeout        = 0.1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.trace_requests        = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler.trace_sqlalchemy      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler_jaeger.process_tags   = {} {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler_jaeger.service_name_prefix = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] profiler_otlp.service_name_prefix = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] remote_debug.host              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] remote_debug.port              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_notifications.retry = -1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.auth_section        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.auth_type           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.cafile              = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.certfile            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.collect_timing      = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.connect_retries     = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.connect_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.endpoint_id         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.endpoint_override   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.insecure            = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.keyfile             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.max_version         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.min_version         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.region_name         = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.service_name        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.service_type        = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.split_loggers       = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.status_code_retries = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.status_code_retry_delay = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.timeout             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.valid_interfaces    = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_limit.version             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_reports.file_event_handler = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] oslo_reports.log_dir           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_ovs_privileged.group  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] vif_plug_ovs_privileged.user   = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_ovs.isolate_vif         = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] os_brick.lock_path             = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] privsep_osbrick.capabilities   = [21] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] privsep_osbrick.group          = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] privsep_osbrick.helper_command = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] privsep_osbrick.user           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] nova_sys_admin.group           = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] nova_sys_admin.helper_command  = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] nova_sys_admin.user            = None {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG oslo_service.service [None req-2c830d3a-13b8-4089-aae6-4d955aa50f27 None None] ******************************************************************************** {{(pid=73144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 21:40:49 user nova-compute[73144]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 21:40:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Starting native event thread {{(pid=73144) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Starting green dispatch thread {{(pid=73144) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Starting connection event dispatch thread {{(pid=73144) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Connecting to libvirt: qemu:///system {{(pid=73144) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa180f04ca0> {{(pid=73144) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 21:40:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa180f04ca0> {{(pid=73144) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 21:40:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Connection event '1' reason 'None'
Aug 14 21:40:49 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 21:40:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.mount [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Initialising _HostMountState generation 0 {{(pid=73144) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 21:40:56 user nova-compute[73144]: INFO nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host capabilities <capabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <host>
Aug 14 21:40:56 user nova-compute[73144]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 21:40:56 user nova-compute[73144]:     <cpu>
Aug 14 21:40:56 user nova-compute[73144]:       <arch>x86_64</arch>
Aug 14 21:40:56 user nova-compute[73144]:       <model>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <microcode version='1070'/>
Aug 14 21:40:56 user nova-compute[73144]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 21:40:56 user nova-compute[73144]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='osxsave'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='invtsc'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='rsba'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 21:40:56 user nova-compute[73144]:       <pages unit='KiB' size='4'/>
Aug 14 21:40:56 user nova-compute[73144]:       <pages unit='KiB' size='2048'/>
Aug 14 21:40:56 user nova-compute[73144]:     </cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <power_management>
Aug 14 21:40:56 user nova-compute[73144]:       <suspend_mem/>
Aug 14 21:40:56 user nova-compute[73144]:       <suspend_disk/>
Aug 14 21:40:56 user nova-compute[73144]:       <suspend_hybrid/>
Aug 14 21:40:56 user nova-compute[73144]:     </power_management>
Aug 14 21:40:56 user nova-compute[73144]:     <iommu support='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <migration_features>
Aug 14 21:40:56 user nova-compute[73144]:       <live/>
Aug 14 21:40:56 user nova-compute[73144]:       <uri_transports>
Aug 14 21:40:56 user nova-compute[73144]:         <uri_transport>tcp</uri_transport>
Aug 14 21:40:56 user nova-compute[73144]:         <uri_transport>rdma</uri_transport>
Aug 14 21:40:56 user nova-compute[73144]:       </uri_transports>
Aug 14 21:40:56 user nova-compute[73144]:     </migration_features>
Aug 14 21:40:56 user nova-compute[73144]:     <topology>
Aug 14 21:40:56 user nova-compute[73144]:       <cells num='2'>
Aug 14 21:40:56 user nova-compute[73144]:         <cell id='0'>
Aug 14 21:40:56 user nova-compute[73144]:           <memory unit='KiB'>8189224</memory>
Aug 14 21:40:56 user nova-compute[73144]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 14 21:40:56 user nova-compute[73144]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 21:40:56 user nova-compute[73144]:           <distances>
Aug 14 21:40:56 user nova-compute[73144]:             <sibling id='0' value='10'/>
Aug 14 21:40:56 user nova-compute[73144]:             <sibling id='1' value='20'/>
Aug 14 21:40:56 user nova-compute[73144]:           </distances>
Aug 14 21:40:56 user nova-compute[73144]:           <cpus num='6'>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 21:40:56 user nova-compute[73144]:           </cpus>
Aug 14 21:40:56 user nova-compute[73144]:         </cell>
Aug 14 21:40:56 user nova-compute[73144]:         <cell id='1'>
Aug 14 21:40:56 user nova-compute[73144]:           <memory unit='KiB'>8206460</memory>
Aug 14 21:40:56 user nova-compute[73144]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 14 21:40:56 user nova-compute[73144]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 21:40:56 user nova-compute[73144]:           <distances>
Aug 14 21:40:56 user nova-compute[73144]:             <sibling id='0' value='20'/>
Aug 14 21:40:56 user nova-compute[73144]:             <sibling id='1' value='10'/>
Aug 14 21:40:56 user nova-compute[73144]:           </distances>
Aug 14 21:40:56 user nova-compute[73144]:           <cpus num='6'>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 21:40:56 user nova-compute[73144]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 21:40:56 user nova-compute[73144]:           </cpus>
Aug 14 21:40:56 user nova-compute[73144]:         </cell>
Aug 14 21:40:56 user nova-compute[73144]:       </cells>
Aug 14 21:40:56 user nova-compute[73144]:     </topology>
Aug 14 21:40:56 user nova-compute[73144]:     <cache>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 21:40:56 user nova-compute[73144]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 21:40:56 user nova-compute[73144]:     </cache>
Aug 14 21:40:56 user nova-compute[73144]:     <secmodel>
Aug 14 21:40:56 user nova-compute[73144]:       <model>apparmor</model>
Aug 14 21:40:56 user nova-compute[73144]:       <doi>0</doi>
Aug 14 21:40:56 user nova-compute[73144]:     </secmodel>
Aug 14 21:40:56 user nova-compute[73144]:     <secmodel>
Aug 14 21:40:56 user nova-compute[73144]:       <model>dac</model>
Aug 14 21:40:56 user nova-compute[73144]:       <doi>0</doi>
Aug 14 21:40:56 user nova-compute[73144]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 21:40:56 user nova-compute[73144]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 21:40:56 user nova-compute[73144]:     </secmodel>
Aug 14 21:40:56 user nova-compute[73144]:   </host>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='alpha'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>clipper</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='armv6l'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>spitz</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>nuri</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>kzm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sx1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>z2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>tosa</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>n810</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>n800</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>terrier</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>midway</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>microbit</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>verdex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>highbank</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>akita</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>connex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>collie</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='armv7l'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>spitz</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>nuri</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>kzm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sx1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>z2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>tosa</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>n810</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>n800</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>terrier</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>midway</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>microbit</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>verdex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>highbank</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>akita</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>connex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>collie</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='aarch64'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>spitz</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>nuri</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>kzm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sx1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>z2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>tosa</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>n810</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>n800</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>terrier</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>midway</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>microbit</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>verdex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>highbank</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>akita</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>connex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>collie</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <acpi default='on' toggle='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='cris'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='i686'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>isapc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>microvm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='kvm'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <pae/>
Aug 14 21:40:56 user nova-compute[73144]:       <nonpae/>
Aug 14 21:40:56 user nova-compute[73144]:       <acpi default='on' toggle='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:       <apic default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='m68k'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>an5206</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>q800</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='microblaze'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='microblazeel'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='mips'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='16'>malta</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='mipsel'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='16'>malta</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='mips64'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='16'>malta</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>pica61</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>magnum</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='mips64el'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='16'>malta</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>pica61</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>magnum</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='16'>boston</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='ppc'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mac99</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>40p</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>taihu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='ppc64'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>taihu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>40p</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mac99</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='ppc64le'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>taihu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>40p</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>mac99</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='riscv32'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='8'>spike</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='8'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='riscv64'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='8'>spike</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='8'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='s390x'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='sh4'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>shix</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>r2d</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='sh4eb'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>shix</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>r2d</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='sparc'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>LX</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='sparc64'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>niagara</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='x86_64'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>64</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='1'>isapc</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>microvm</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='kvm'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <acpi default='on' toggle='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:       <apic default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='xtensa'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>sim</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>kc705</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>ml605</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx200</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx60</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]:   <guest>
Aug 14 21:40:56 user nova-compute[73144]:     <os_type>hvm</os_type>
Aug 14 21:40:56 user nova-compute[73144]:     <arch name='xtensaeb'>
Aug 14 21:40:56 user nova-compute[73144]:       <wordsize>32</wordsize>
Aug 14 21:40:56 user nova-compute[73144]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='4'>sim</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>kc705</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>ml605</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>virt</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx200</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>lx60</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 21:40:56 user nova-compute[73144]:       <domain type='qemu'/>
Aug 14 21:40:56 user nova-compute[73144]:     </arch>
Aug 14 21:40:56 user nova-compute[73144]:     <features>
Aug 14 21:40:56 user nova-compute[73144]:       <cpuselection/>
Aug 14 21:40:56 user nova-compute[73144]:       <deviceboot/>
Aug 14 21:40:56 user nova-compute[73144]:       <disksnapshot default='on' toggle='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     </features>
Aug 14 21:40:56 user nova-compute[73144]:   </guest>
Aug 14 21:40:56 user nova-compute[73144]: </capabilities>
Aug 14 21:40:56 user nova-compute[73144]: 
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-q35-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>i686</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='288'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'/>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='lm'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-q35-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>i686</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='288'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'/>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='lm'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-i440fx-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>i686</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='255'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'/>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='lm'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ide</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-i440fx-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>i686</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='255'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'/>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='lm'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ide</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-q35-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>x86_64</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='288'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>efi</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='invtsc'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='rsba'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-q35-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>x86_64</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='288'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>efi</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='invtsc'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='rsba'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-i440fx-6.2</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>x86_64</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='255'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>efi</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='invtsc'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='rsba'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ide</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 21:40:56 user nova-compute[73144]: <domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 21:40:56 user nova-compute[73144]:   <domain>kvm</domain>
Aug 14 21:40:56 user nova-compute[73144]:   <machine>pc-i440fx-jammy</machine>
Aug 14 21:40:56 user nova-compute[73144]:   <arch>x86_64</arch>
Aug 14 21:40:56 user nova-compute[73144]:   <vcpu max='255'/>
Aug 14 21:40:56 user nova-compute[73144]:   <iothreads supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:   <os supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='firmware'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>efi</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:     <loader supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>rom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pflash</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='readonly'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>yes</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='secure'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>no</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </loader>
Aug 14 21:40:56 user nova-compute[73144]:   </os>
Aug 14 21:40:56 user nova-compute[73144]:   <cpu>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-passthrough' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='hostPassthroughMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='maximum' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='maximumMigratable'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>on</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>off</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='host-model' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <vendor>Intel</vendor>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ss'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='vmx'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pcid'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='hypervisor'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arat'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='umip'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='md-clear'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='invtsc'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibpb'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='ibrs'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-stibp'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='rsba'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='erms'/>
Aug 14 21:40:56 user nova-compute[73144]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:     <mode name='custom' supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>qemu64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>qemu32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>phenom</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>pentium</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>n270</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm64</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>kvm32</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>coreduo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>core2duo</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>athlon</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Westmere</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Snowridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Skylake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>SandyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Penryn</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G5</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G4</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G3</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Opteron_G2</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Opteron_G1</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>IvyBridge</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Icelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Haswell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Rome</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-Milan</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>EPYC</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Dhyana</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cooperlake</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>Conroe</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='no'>Broadwell</model>
Aug 14 21:40:56 user nova-compute[73144]:       <model usable='yes'>486</model>
Aug 14 21:40:56 user nova-compute[73144]:     </mode>
Aug 14 21:40:56 user nova-compute[73144]:   </cpu>
Aug 14 21:40:56 user nova-compute[73144]:   <memoryBacking supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:     <enum name='sourceType'>
Aug 14 21:40:56 user nova-compute[73144]:       <value>file</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>anonymous</value>
Aug 14 21:40:56 user nova-compute[73144]:       <value>memfd</value>
Aug 14 21:40:56 user nova-compute[73144]:     </enum>
Aug 14 21:40:56 user nova-compute[73144]:   </memoryBacking>
Aug 14 21:40:56 user nova-compute[73144]:   <devices>
Aug 14 21:40:56 user nova-compute[73144]:     <disk supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='diskDevice'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>disk</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cdrom</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>floppy</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>lun</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='bus'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ide</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>fdc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sata</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </disk>
Aug 14 21:40:56 user nova-compute[73144]:     <graphics supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='type'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>sdl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vnc</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>spice</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egl-headless</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </graphics>
Aug 14 21:40:56 user nova-compute[73144]:     <video supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='modelType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>cirrus</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>vmvga</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>qxl</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>none</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>bochs</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>ramfb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </video>
Aug 14 21:40:56 user nova-compute[73144]:     <hostdev supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='mode'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>subsystem</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='startupPolicy'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>default</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>mandatory</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>requisite</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>optional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='subsysType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>usb</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>pci</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>scsi</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='capsType'/>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='pciBackend'/>
Aug 14 21:40:56 user nova-compute[73144]:     </hostdev>
Aug 14 21:40:56 user nova-compute[73144]:     <rng supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtio-non-transitional</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>random</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>egd</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>builtin</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </rng>
Aug 14 21:40:56 user nova-compute[73144]:     <filesystem supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='driverType'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>path</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>handle</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>virtiofs</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </filesystem>
Aug 14 21:40:56 user nova-compute[73144]:     <tpm supported='yes'>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='model'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-tis</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>tpm-crb</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:       <enum name='backendModel'>
Aug 14 21:40:56 user nova-compute[73144]:         <value>passthrough</value>
Aug 14 21:40:56 user nova-compute[73144]:         <value>emulator</value>
Aug 14 21:40:56 user nova-compute[73144]:       </enum>
Aug 14 21:40:56 user nova-compute[73144]:     </tpm>
Aug 14 21:40:56 user nova-compute[73144]:   </devices>
Aug 14 21:40:56 user nova-compute[73144]:   <features>
Aug 14 21:40:56 user nova-compute[73144]:     <gic supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:     <vmcoreinfo supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <genid supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backingStoreInput supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <backup supported='yes'/>
Aug 14 21:40:56 user nova-compute[73144]:     <sev supported='no'/>
Aug 14 21:40:56 user nova-compute[73144]:   </features>
Aug 14 21:40:56 user nova-compute[73144]: </domainCapabilities>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73144) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73144) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Checking secure boot support for host arch (x86_64) {{(pid=73144) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 21:40:56 user nova-compute[73144]: INFO nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Secure Boot support detected
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] cpu compare xml: <cpu match="exact">
Aug 14 21:40:56 user nova-compute[73144]:   <model>Nehalem</model>
Aug 14 21:40:56 user nova-compute[73144]: </cpu>
Aug 14 21:40:56 user nova-compute[73144]:  {{(pid=73144) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 21:40:56 user nova-compute[73144]: INFO nova.virt.node [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Generated node identity fcca1cea-a902-4b33-85fb-860d4db9f73e
Aug 14 21:40:56 user nova-compute[73144]: INFO nova.virt.node [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Wrote node identity fcca1cea-a902-4b33-85fb-860d4db9f73e to /opt/stack/data/nova/compute_id
Aug 14 21:40:56 user nova-compute[73144]: WARNING nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Compute nodes ['fcca1cea-a902-4b33-85fb-860d4db9f73e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 21:40:56 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 21:40:56 user nova-compute[73144]: WARNING nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 21:40:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:40:56 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:40:57 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:40:57 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Hypervisor/Node resource view: name=user free_ram=10895MB free_disk=26.217845916748047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:40:57 user nova-compute[73144]: WARNING nova.compute.resource_tracker [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] No compute node record for user:fcca1cea-a902-4b33-85fb-860d4db9f73e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fcca1cea-a902-4b33-85fb-860d4db9f73e could not be found.
Aug 14 21:40:57 user nova-compute[73144]: INFO nova.compute.resource_tracker [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Compute node record created for user:user with uuid: fcca1cea-a902-4b33-85fb-860d4db9f73e
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:40:57 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [req-68d5bae0-5552-4561-b8cc-73196ec3fa32] Created resource provider record via placement API for resource provider with UUID fcca1cea-a902-4b33-85fb-860d4db9f73e and name user.
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73144) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 21:40:57 user nova-compute[73144]: INFO nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] kernel doesn't support AMD SEV
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Libvirt baseline CPU <cpu>
Aug 14 21:40:57 user nova-compute[73144]:   <arch>x86_64</arch>
Aug 14 21:40:57 user nova-compute[73144]:   <model>Nehalem</model>
Aug 14 21:40:57 user nova-compute[73144]:   <vendor>Intel</vendor>
Aug 14 21:40:57 user nova-compute[73144]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 21:40:57 user nova-compute[73144]: </cpu>
Aug 14 21:40:57 user nova-compute[73144]:  {{(pid=73144) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Updated inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Updating resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e generation from 0 to 1 during operation: update_inventory {{(pid=73144) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Updating resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e generation from 1 to 2 during operation: update_traits {{(pid=73144) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.service [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Creating RPC server for service compute {{(pid=73144) start /opt/stack/nova/nova/service.py:182}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.service [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Join ServiceGroup membership for this service compute {{(pid=73144) start /opt/stack/nova/nova/service.py:199}}
Aug 14 21:40:57 user nova-compute[73144]: DEBUG nova.servicegroup.drivers.db [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73144) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 21:41:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:41:48 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:41:48 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:41:48 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=10310MB free_disk=26.121559143066406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:41:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:41:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:41:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:41:49 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:41:49 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:41:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:41:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:42:49 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:42:49 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=10287MB free_disk=26.167617797851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:42:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:42:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:42:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:42:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:42:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:43:50 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:43:50 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:43:50 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=10255MB free_disk=25.951793670654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:43:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:43:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:43:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:43:51 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:43:51 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:43:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:43:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:43:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:43:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:44:50 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:44:51 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:44:51 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:44:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=9491MB free_disk=25.974349975585938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:44:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:44:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:44:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:44:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:44:53 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:53 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:44:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:44:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:44:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:44:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:44:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:44:57 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:44:57 user nova-compute[73144]: INFO nova.compute.claims [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Claim successful on node user
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:44:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:44:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Creating image(s)
Aug 14 21:44:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "/opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "/opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "/opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:44:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:44:59 user nova-compute[73144]: DEBUG nova.policy [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '357a1593e398410d8165908904fdc642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0a65555fb74c488d074154dd2d5211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:44:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:44:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.part --force-share --output=json" returned: 0 in 0.206s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:44:59 user nova-compute[73144]: DEBUG nova.virt.images [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] 53539290-1600-4e84-8f24-496f41396a43 was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 21:44:59 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:44:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.part /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.part /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.converted" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.868s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:00 user nova-compute[73144]: INFO oslo.privsep.daemon [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsol2mwqs/privsep.sock']
Aug 14 21:45:00 user sudo[82419]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsol2mwqs/privsep.sock
Aug 14 21:45:00 user sudo[82419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 21:45:01 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Successfully created port: dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:02 user sudo[82419]: pam_unix(sudo:session): session closed for user root
Aug 14 21:45:02 user nova-compute[73144]: INFO oslo.privsep.daemon [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Spawned new privsep daemon via rootwrap
Aug 14 21:45:02 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 21:45:02 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 21:45:02 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 21:45:02 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82424
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.151s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.168s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk 1073741824" returned: 0 in 0.163s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.206s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Cannot resize image /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lazy-loading 'migration_context' on Instance uuid e17e5d16-9301-4788-ae7d-495c36e6df58 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Ensure instance console log exists: /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Successfully updated port: dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquired lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updating instance_info_cache with network_info: [{"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Releasing lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Instance network_info: |[{"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Start _get_guest_xml network_info=[{"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:04 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:04 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1272237829',display_name='tempest-DeleteServersTestJSON-server-1272237829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1272237829',id=1,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e0a65555fb74c488d074154dd2d5211',ramdisk_id='',reservation_id='r-nzy8kffr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-253902441',owner_user_name='tempest-DeleteServersTestJSON-253902441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:44:58Z,user_data=None,user_id='357a1593e398410d8165908904fdc642',uuid=e17e5d16-9301-4788-ae7d-495c36e6df58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Converting VIF {"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:34:e9,bridge_name='br-int',has_traffic_filtering=True,id=dc20fc88-2533-4fab-9157-8ef1a79e06a3,network=Network(75f03656-3a5d-426c-bf1d-3b2fb46ff4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc20fc88-25') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lazy-loading 'pci_devices' on Instance uuid e17e5d16-9301-4788-ae7d-495c36e6df58 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:04 user nova-compute[73144]:   <uuid>e17e5d16-9301-4788-ae7d-495c36e6df58</uuid>
Aug 14 21:45:04 user nova-compute[73144]:   <name>instance-00000001</name>
Aug 14 21:45:04 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:04 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:04 user nova-compute[73144]:   <metadata>
Aug 14 21:45:04 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:04 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:04 user nova-compute[73144]:       <nova:name>tempest-DeleteServersTestJSON-server-1272237829</nova:name>
Aug 14 21:45:04 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:04</nova:creationTime>
Aug 14 21:45:04 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:04 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:04 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:04 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:04 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:04 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:04 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:04 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:04 user nova-compute[73144]:         <nova:user uuid="357a1593e398410d8165908904fdc642">tempest-DeleteServersTestJSON-253902441-project-member</nova:user>
Aug 14 21:45:04 user nova-compute[73144]:         <nova:project uuid="3e0a65555fb74c488d074154dd2d5211">tempest-DeleteServersTestJSON-253902441</nova:project>
Aug 14 21:45:04 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:04 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:04 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:04 user nova-compute[73144]:         <nova:port uuid="dc20fc88-2533-4fab-9157-8ef1a79e06a3">
Aug 14 21:45:04 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 21:45:04 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:04 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:04 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:04 user nova-compute[73144]:   </metadata>
Aug 14 21:45:04 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:04 user nova-compute[73144]:     <system>
Aug 14 21:45:04 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:04 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:04 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:04 user nova-compute[73144]:       <entry name="serial">e17e5d16-9301-4788-ae7d-495c36e6df58</entry>
Aug 14 21:45:04 user nova-compute[73144]:       <entry name="uuid">e17e5d16-9301-4788-ae7d-495c36e6df58</entry>
Aug 14 21:45:04 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:04 user nova-compute[73144]:     </system>
Aug 14 21:45:04 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:04 user nova-compute[73144]:   <os>
Aug 14 21:45:04 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:04 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:04 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:04 user nova-compute[73144]:   </os>
Aug 14 21:45:04 user nova-compute[73144]:   <features>
Aug 14 21:45:04 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:04 user nova-compute[73144]:     <apic/>
Aug 14 21:45:04 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:04 user nova-compute[73144]:   </features>
Aug 14 21:45:04 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:04 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:04 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:04 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:04 user nova-compute[73144]:   </clock>
Aug 14 21:45:04 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:04 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:04 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:04 user nova-compute[73144]:   </cpu>
Aug 14 21:45:04 user nova-compute[73144]:   <devices>
Aug 14 21:45:04 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:04 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:04 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk"/>
Aug 14 21:45:04 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:04 user nova-compute[73144]:     </disk>
Aug 14 21:45:04 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:04 user nova-compute[73144]:       <mac address="fa:16:3e:fe:34:e9"/>
Aug 14 21:45:04 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:04 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:04 user nova-compute[73144]:       <target dev="tapdc20fc88-25"/>
Aug 14 21:45:04 user nova-compute[73144]:     </interface>
Aug 14 21:45:04 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:04 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/console.log" append="off"/>
Aug 14 21:45:04 user nova-compute[73144]:     </serial>
Aug 14 21:45:04 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:04 user nova-compute[73144]:     <video>
Aug 14 21:45:04 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:04 user nova-compute[73144]:     </video>
Aug 14 21:45:04 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:04 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:04 user nova-compute[73144]:     </rng>
Aug 14 21:45:04 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:04 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:04 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:04 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:04 user nova-compute[73144]:   </devices>
Aug 14 21:45:04 user nova-compute[73144]: </domain>
Aug 14 21:45:04 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1272237829',display_name='tempest-DeleteServersTestJSON-server-1272237829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1272237829',id=1,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e0a65555fb74c488d074154dd2d5211',ramdisk_id='',reservation_id='r-nzy8kffr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-253902441',owner_user_name='tempest-DeleteServersTestJSON-253902441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:44:58Z,user_data=None,user_id='357a1593e398410d8165908904fdc642',uuid=e17e5d16-9301-4788-ae7d-495c36e6df58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Converting VIF {"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:34:e9,bridge_name='br-int',has_traffic_filtering=True,id=dc20fc88-2533-4fab-9157-8ef1a79e06a3,network=Network(75f03656-3a5d-426c-bf1d-3b2fb46ff4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc20fc88-25') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG os_vif [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:34:e9,bridge_name='br-int',has_traffic_filtering=True,id=dc20fc88-2533-4fab-9157-8ef1a79e06a3,network=Network(75f03656-3a5d-426c-bf1d-3b2fb46ff4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc20fc88-25') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Created schema index Interface.name {{(pid=73144) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Created schema index Port.name {{(pid=73144) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Created schema index Bridge.name {{(pid=73144) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [POLLOUT] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:05 user nova-compute[73144]: INFO oslo.privsep.daemon [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpgbtcq1cc/privsep.sock']
Aug 14 21:45:05 user sudo[82442]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpgbtcq1cc/privsep.sock
Aug 14 21:45:05 user sudo[82442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 21:45:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received event network-changed-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Refreshing instance network info cache due to event network-changed-dc20fc88-2533-4fab-9157-8ef1a79e06a3. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] Acquiring lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] Acquired lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG nova.network.neutron [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Refreshing network info cache for port dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:06 user nova-compute[73144]: INFO nova.compute.claims [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Claim successful on node user
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:06 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:06 user nova-compute[73144]: INFO nova.compute.claims [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Claim successful on node user
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:06 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Creating image(s)
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "/opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.policy [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '597588abcb1a4963a536b2b078ceef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b004e49247a041b7b00500416a625ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.198s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:07 user sudo[82442]: pam_unix(sudo:session): session closed for user root
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:07 user nova-compute[73144]: INFO oslo.privsep.daemon [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Spawned new privsep daemon via rootwrap
Aug 14 21:45:07 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 21:45:07 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 21:45:07 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 21:45:07 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82458
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.237s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.network.neutron [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updated VIF entry in instance network info cache for port dc20fc88-2533-4fab-9157-8ef1a79e06a3. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.network.neutron [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updating instance_info_cache with network_info: [{"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk 1073741824" returned: 0 in 0.066s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c71a8c6f-94f2-49bf-bf3c-34706f07457d req-ef632605-5311-4347-819e-37b28dafba72 service nova] Releasing lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Creating image(s)
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.227s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.policy [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fea6e7a8eb644f9eb8974663217a3a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55f90fe0860498a85da04d2cb3ae6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc20fc88-25, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc20fc88-25, col_values=(('external_ids', {'iface-id': 'dc20fc88-2533-4fab-9157-8ef1a79e06a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:34:e9', 'vm-uuid': 'e17e5d16-9301-4788-ae7d-495c36e6df58'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Cannot resize image /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'migration_context' on Instance uuid c16f9e34-3fc2-49c7-b0b8-99c5e5153818 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:07 user nova-compute[73144]: INFO os_vif [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:34:e9,bridge_name='br-int',has_traffic_filtering=True,id=dc20fc88-2533-4fab-9157-8ef1a79e06a3,network=Network(75f03656-3a5d-426c-bf1d-3b2fb46ff4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc20fc88-25')
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Ensure instance console log exists: /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:07 user nova-compute[73144]: INFO nova.compute.claims [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Claim successful on node user
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] No VIF found with MAC fa:16:3e:fe:34:e9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.217s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk 1073741824" returned: 0 in 0.058s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Cannot resize image /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'migration_context' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Ensure instance console log exists: /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.policy [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89f3461a4f8f45e584180e2b18d782b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842f55070374c288d0e1500d297485e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Creating image(s)
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:08 user nova-compute[73144]: INFO nova.compute.claims [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Claim successful on node user
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.208s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.222s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk 1073741824" returned: 0 in 0.046s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Creating image(s)
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Cannot resize image /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'migration_context' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Successfully created port: 5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Ensure instance console log exists: /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.policy [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24af35347484e5982207ed21f62bc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3eaba4f7824769adb0e2a2a28f3924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.251s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.162s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:09 user nova-compute[73144]: INFO nova.compute.claims [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Claim successful on node user
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk 1073741824" returned: 0 in 0.059s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.166s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Successfully created port: 405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Cannot resize image /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'migration_context' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Ensure instance console log exists: /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Creating image(s)
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "/opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "/opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "/opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:10 user nova-compute[73144]: DEBUG nova.policy [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f236788f6a93453b893ddf6d4cf01c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2005f37baf4b1b99effc98fddd0fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049511.2413938, e17e5d16-9301-4788-ae7d-495c36e6df58 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:11 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] VM Resumed (Lifecycle Event)
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Successfully created port: 3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk 1073741824" returned: 0 in 0.062s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Instance spawned successfully.
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:11 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049511.2787082, e17e5d16-9301-4788-ae7d-495c36e6df58 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:11 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] VM Started (Lifecycle Event)
Aug 14 21:45:11 user nova-compute[73144]: INFO nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Took 13.02 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.215s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:11 user nova-compute[73144]: INFO nova.compute.manager [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Took 13.90 seconds to build instance.
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c4f560ca-cf64-4644-b6bd-6e964fff92b4 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.269s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Cannot resize image /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'migration_context' on Instance uuid b38d8d04-d91a-49d3-9350-e44d2ba576cf {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Ensure instance console log exists: /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Successfully created port: 758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Successfully updated port: 405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Successfully updated port: 5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquired lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquired lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-changed-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Refreshing instance network info cache due to event network-changed-5a900812-f1ea-4f9e-bff4-84e9e72f5f42. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] Acquiring lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-changed-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Refreshing instance network info cache due to event network-changed-405993c1-92ac-4e9f-b75c-44deb4a9f3dd. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] Acquiring lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Successfully created port: 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updating instance_info_cache with network_info: [{"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Releasing lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Instance network_info: |[{"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] Acquired lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Refreshing network info cache for port 5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Start _get_guest_xml network_info=[{"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-890878732',display_name='tempest-AttachVolumeNegativeTest-server-890878732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-890878732',id=2,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6DEttn99Q70VbYA9BkbePkssK/853vx1OLoWAwbjIzFFx8pp3oLBwBF8HMUjAHLmjOjyz1EKf+Ckzeyhm6J7uUmWqAVIOUVVWq9esjMTnECL3PTZZOFAb7fwQbAlXOvw==',key_name='tempest-keypair-374539220',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-8ws9jj9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=c16f9e34-3fc2-49c7-b0b8-99c5e5153818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:20,bridge_name='br-int',has_traffic_filtering=True,id=5a900812-f1ea-4f9e-bff4-84e9e72f5f42,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a900812-f1') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'pci_devices' on Instance uuid c16f9e34-3fc2-49c7-b0b8-99c5e5153818 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:14 user nova-compute[73144]:   <uuid>c16f9e34-3fc2-49c7-b0b8-99c5e5153818</uuid>
Aug 14 21:45:14 user nova-compute[73144]:   <name>instance-00000002</name>
Aug 14 21:45:14 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:14 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:14 user nova-compute[73144]:   <metadata>
Aug 14 21:45:14 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:14 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeNegativeTest-server-890878732</nova:name>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:14</nova:creationTime>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:14 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:14 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:user uuid="597588abcb1a4963a536b2b078ceef23">tempest-AttachVolumeNegativeTest-1600069366-project-member</nova:user>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:project uuid="b004e49247a041b7b00500416a625ca7">tempest-AttachVolumeNegativeTest-1600069366</nova:project>
Aug 14 21:45:14 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:port uuid="5a900812-f1ea-4f9e-bff4-84e9e72f5f42">
Aug 14 21:45:14 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:45:14 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:14 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:14 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:14 user nova-compute[73144]:   </metadata>
Aug 14 21:45:14 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:14 user nova-compute[73144]:     <system>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="serial">c16f9e34-3fc2-49c7-b0b8-99c5e5153818</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="uuid">c16f9e34-3fc2-49c7-b0b8-99c5e5153818</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:14 user nova-compute[73144]:     </system>
Aug 14 21:45:14 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:14 user nova-compute[73144]:   <os>
Aug 14 21:45:14 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:14 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:14 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:14 user nova-compute[73144]:   </os>
Aug 14 21:45:14 user nova-compute[73144]:   <features>
Aug 14 21:45:14 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:14 user nova-compute[73144]:     <apic/>
Aug 14 21:45:14 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:14 user nova-compute[73144]:   </features>
Aug 14 21:45:14 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:14 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:14 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:14 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:14 user nova-compute[73144]:   </clock>
Aug 14 21:45:14 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:14 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:14 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:14 user nova-compute[73144]:   </cpu>
Aug 14 21:45:14 user nova-compute[73144]:   <devices>
Aug 14 21:45:14 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:14 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:14 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk"/>
Aug 14 21:45:14 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:14 user nova-compute[73144]:     </disk>
Aug 14 21:45:14 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:14 user nova-compute[73144]:       <mac address="fa:16:3e:5d:e4:20"/>
Aug 14 21:45:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:14 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:14 user nova-compute[73144]:       <target dev="tap5a900812-f1"/>
Aug 14 21:45:14 user nova-compute[73144]:     </interface>
Aug 14 21:45:14 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:14 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/console.log" append="off"/>
Aug 14 21:45:14 user nova-compute[73144]:     </serial>
Aug 14 21:45:14 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:14 user nova-compute[73144]:     <video>
Aug 14 21:45:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:14 user nova-compute[73144]:     </video>
Aug 14 21:45:14 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:14 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:14 user nova-compute[73144]:     </rng>
Aug 14 21:45:14 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:14 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:14 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:14 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:14 user nova-compute[73144]:   </devices>
Aug 14 21:45:14 user nova-compute[73144]: </domain>
Aug 14 21:45:14 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-890878732',display_name='tempest-AttachVolumeNegativeTest-server-890878732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-890878732',id=2,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6DEttn99Q70VbYA9BkbePkssK/853vx1OLoWAwbjIzFFx8pp3oLBwBF8HMUjAHLmjOjyz1EKf+Ckzeyhm6J7uUmWqAVIOUVVWq9esjMTnECL3PTZZOFAb7fwQbAlXOvw==',key_name='tempest-keypair-374539220',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-8ws9jj9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=c16f9e34-3fc2-49c7-b0b8-99c5e5153818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:20,bridge_name='br-int',has_traffic_filtering=True,id=5a900812-f1ea-4f9e-bff4-84e9e72f5f42,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a900812-f1') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG os_vif [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:20,bridge_name='br-int',has_traffic_filtering=True,id=5a900812-f1ea-4f9e-bff4-84e9e72f5f42,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a900812-f1') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Releasing lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance network_info: |[{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] Acquired lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Refreshing network info cache for port 405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Start _get_guest_xml network_info=[{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a900812-f1, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a900812-f1, col_values=(('external_ids', {'iface-id': '5a900812-f1ea-4f9e-bff4-84e9e72f5f42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:e4:20', 'vm-uuid': 'c16f9e34-3fc2-49c7-b0b8-99c5e5153818'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:14 user nova-compute[73144]: INFO os_vif [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e4:20,bridge_name='br-int',has_traffic_filtering=True,id=5a900812-f1ea-4f9e-bff4-84e9e72f5f42,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a900812-f1')
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:14 user nova-compute[73144]:   <uuid>5fb72bd6-7deb-4a48-b1ef-410911faec15</uuid>
Aug 14 21:45:14 user nova-compute[73144]:   <name>instance-00000004</name>
Aug 14 21:45:14 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:14 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:14 user nova-compute[73144]:   <metadata>
Aug 14 21:45:14 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:14 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeTestJSON-server-1723144730</nova:name>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:14</nova:creationTime>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:14 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:14 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:user uuid="89f3461a4f8f45e584180e2b18d782b0">tempest-AttachVolumeTestJSON-881893264-project-member</nova:user>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:project uuid="3842f55070374c288d0e1500d297485e">tempest-AttachVolumeTestJSON-881893264</nova:project>
Aug 14 21:45:14 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:14 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:14 user nova-compute[73144]:         <nova:port uuid="405993c1-92ac-4e9f-b75c-44deb4a9f3dd">
Aug 14 21:45:14 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 21:45:14 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:14 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:14 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:14 user nova-compute[73144]:   </metadata>
Aug 14 21:45:14 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:14 user nova-compute[73144]:     <system>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="serial">5fb72bd6-7deb-4a48-b1ef-410911faec15</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="uuid">5fb72bd6-7deb-4a48-b1ef-410911faec15</entry>
Aug 14 21:45:14 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:14 user nova-compute[73144]:     </system>
Aug 14 21:45:14 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:14 user nova-compute[73144]:   <os>
Aug 14 21:45:14 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:14 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:14 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:14 user nova-compute[73144]:   </os>
Aug 14 21:45:14 user nova-compute[73144]:   <features>
Aug 14 21:45:14 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:14 user nova-compute[73144]:     <apic/>
Aug 14 21:45:14 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:14 user nova-compute[73144]:   </features>
Aug 14 21:45:14 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:14 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:14 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:14 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:14 user nova-compute[73144]:   </clock>
Aug 14 21:45:14 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:14 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:14 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:14 user nova-compute[73144]:   </cpu>
Aug 14 21:45:14 user nova-compute[73144]:   <devices>
Aug 14 21:45:14 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:14 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:14 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk"/>
Aug 14 21:45:14 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:14 user nova-compute[73144]:     </disk>
Aug 14 21:45:14 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:14 user nova-compute[73144]:       <mac address="fa:16:3e:fb:d3:d3"/>
Aug 14 21:45:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:14 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:14 user nova-compute[73144]:       <target dev="tap405993c1-92"/>
Aug 14 21:45:14 user nova-compute[73144]:     </interface>
Aug 14 21:45:14 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:14 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/console.log" append="off"/>
Aug 14 21:45:14 user nova-compute[73144]:     </serial>
Aug 14 21:45:14 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:14 user nova-compute[73144]:     <video>
Aug 14 21:45:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:14 user nova-compute[73144]:     </video>
Aug 14 21:45:14 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:14 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:14 user nova-compute[73144]:     </rng>
Aug 14 21:45:14 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:14 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:14 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:14 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:14 user nova-compute[73144]:   </devices>
Aug 14 21:45:14 user nova-compute[73144]: </domain>
Aug 14 21:45:14 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG os_vif [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap405993c1-92, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap405993c1-92, col_values=(('external_ids', {'iface-id': '405993c1-92ac-4e9f-b75c-44deb4a9f3dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:d3:d3', 'vm-uuid': '5fb72bd6-7deb-4a48-b1ef-410911faec15'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:14 user nova-compute[73144]: INFO os_vif [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92')
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No VIF found with MAC fa:16:3e:5d:e4:20, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No VIF found with MAC fa:16:3e:fb:d3:d3, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Successfully updated port: 3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing instance network info cache due to event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Successfully updated port: 758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received event network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] No waiting events found dispatching network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:15 user nova-compute[73144]: WARNING nova.compute.manager [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received unexpected event network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 for instance with vm_state active and task_state None.
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received event network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] No waiting events found dispatching network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:15 user nova-compute[73144]: WARNING nova.compute.manager [req-137a843c-a334-4df6-b15b-579a0199afbb req-fb72ec92-c76c-491b-adf2-d6102848b2f6 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received unexpected event network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 for instance with vm_state active and task_state None.
Aug 14 21:45:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-changed-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Refreshing instance network info cache due to event network-changed-758cbe79-b4b9-40b7-93a4-37b07664efb4. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updated VIF entry in instance network info cache for port 5a900812-f1ea-4f9e-bff4-84e9e72f5f42. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updating instance_info_cache with network_info: [{"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-befe9c2d-420a-4ff1-9647-03c19d9f9ed6 req-df4771fb-bf4b-47d6-ab88-b0e4f1aba65d service nova] Releasing lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Successfully updated port: 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquired lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:16 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updated VIF entry in instance network info cache for port 405993c1-92ac-4e9f-b75c-44deb4a9f3dd. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance network_info: |[{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Start _get_guest_xml network_info=[{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-91185aa8-5a73-46af-8e6b-cec157d8ee8c req-a6e59c4a-15a7-4966-a7a7-3579aeb37201 service nova] Releasing lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance network_info: |[{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Refreshing network info cache for port 758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Start _get_guest_xml network_info=[{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-914541680',display_name='tempest-ServerStableDeviceRescueTest-server-914541680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-914541680',id=3,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvqPD1XevevnipezL0SjTUgZvZ3XCWMcpzIT8W1Hz8KROs2Dej1ChQ3ovfHHgZSHgPR+Q79GjA2RDLnkzpqH66uQu+6OSrmRkc4iMBUpC+s/Bq8BLmXbNVtz9y6R7CGKQ==',key_name='tempest-keypair-1696462956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f55f90fe0860498a85da04d2cb3ae6e4',ramdisk_id='',reservation_id='r-rso97t23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-744721021',owner_user_name='tempest-ServerStableDeviceRescueTest-744721021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea6e7a8eb644f9eb8974663217a3a98',uuid=ae3ee52c-0811-4c67-a43e-736e02c5511d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converting VIF {"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'pci_devices' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'pci_devices' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:17 user nova-compute[73144]:   <uuid>ae3ee52c-0811-4c67-a43e-736e02c5511d</uuid>
Aug 14 21:45:17 user nova-compute[73144]:   <name>instance-00000003</name>
Aug 14 21:45:17 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:17 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:17 user nova-compute[73144]:   <metadata>
Aug 14 21:45:17 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:17 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-914541680</nova:name>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:17</nova:creationTime>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:17 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:user uuid="fea6e7a8eb644f9eb8974663217a3a98">tempest-ServerStableDeviceRescueTest-744721021-project-member</nova:user>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:project uuid="f55f90fe0860498a85da04d2cb3ae6e4">tempest-ServerStableDeviceRescueTest-744721021</nova:project>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:port uuid="3637b061-93ae-454c-88ff-45478c8bdcda">
Aug 14 21:45:17 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:45:17 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:17 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:17 user nova-compute[73144]:   </metadata>
Aug 14 21:45:17 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:17 user nova-compute[73144]:     <system>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="serial">ae3ee52c-0811-4c67-a43e-736e02c5511d</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="uuid">ae3ee52c-0811-4c67-a43e-736e02c5511d</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:17 user nova-compute[73144]:     </system>
Aug 14 21:45:17 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:17 user nova-compute[73144]:   <os>
Aug 14 21:45:17 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:17 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:17 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:17 user nova-compute[73144]:   </os>
Aug 14 21:45:17 user nova-compute[73144]:   <features>
Aug 14 21:45:17 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:17 user nova-compute[73144]:     <apic/>
Aug 14 21:45:17 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:17 user nova-compute[73144]:   </features>
Aug 14 21:45:17 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:17 user nova-compute[73144]:   </clock>
Aug 14 21:45:17 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:17 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:17 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:17 user nova-compute[73144]:   </cpu>
Aug 14 21:45:17 user nova-compute[73144]:   <devices>
Aug 14 21:45:17 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:17 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:17 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk"/>
Aug 14 21:45:17 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:     </disk>
Aug 14 21:45:17 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:17 user nova-compute[73144]:       <mac address="fa:16:3e:31:42:f6"/>
Aug 14 21:45:17 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:17 user nova-compute[73144]:       <target dev="tap3637b061-93"/>
Aug 14 21:45:17 user nova-compute[73144]:     </interface>
Aug 14 21:45:17 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:17 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/console.log" append="off"/>
Aug 14 21:45:17 user nova-compute[73144]:     </serial>
Aug 14 21:45:17 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:17 user nova-compute[73144]:     <video>
Aug 14 21:45:17 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:     </video>
Aug 14 21:45:17 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:17 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:17 user nova-compute[73144]:     </rng>
Aug 14 21:45:17 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:17 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:17 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:17 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:17 user nova-compute[73144]:   </devices>
Aug 14 21:45:17 user nova-compute[73144]: </domain>
Aug 14 21:45:17 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-914541680',display_name='tempest-ServerStableDeviceRescueTest-server-914541680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-914541680',id=3,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvqPD1XevevnipezL0SjTUgZvZ3XCWMcpzIT8W1Hz8KROs2Dej1ChQ3ovfHHgZSHgPR+Q79GjA2RDLnkzpqH66uQu+6OSrmRkc4iMBUpC+s/Bq8BLmXbNVtz9y6R7CGKQ==',key_name='tempest-keypair-1696462956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f55f90fe0860498a85da04d2cb3ae6e4',ramdisk_id='',reservation_id='r-rso97t23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-744721021',owner_user_name='tempest-ServerStableDeviceRescueTest-744721021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea6e7a8eb644f9eb8974663217a3a98',uuid=ae3ee52c-0811-4c67-a43e-736e02c5511d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converting VIF {"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG os_vif [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:17 user nova-compute[73144]:   <uuid>abb6bbee-268b-45c6-b3da-49ecc86944c0</uuid>
Aug 14 21:45:17 user nova-compute[73144]:   <name>instance-00000005</name>
Aug 14 21:45:17 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:17 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:17 user nova-compute[73144]:   <metadata>
Aug 14 21:45:17 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:17 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:name>tempest-ServerActionsTestOtherB-server-504781444</nova:name>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:17</nova:creationTime>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:17 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:user uuid="f24af35347484e5982207ed21f62bc2a">tempest-ServerActionsTestOtherB-679953584-project-member</nova:user>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:project uuid="1c3eaba4f7824769adb0e2a2a28f3924">tempest-ServerActionsTestOtherB-679953584</nova:project>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:port uuid="758cbe79-b4b9-40b7-93a4-37b07664efb4">
Aug 14 21:45:17 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 21:45:17 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:17 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:17 user nova-compute[73144]:   </metadata>
Aug 14 21:45:17 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:17 user nova-compute[73144]:     <system>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="serial">abb6bbee-268b-45c6-b3da-49ecc86944c0</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="uuid">abb6bbee-268b-45c6-b3da-49ecc86944c0</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:17 user nova-compute[73144]:     </system>
Aug 14 21:45:17 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:17 user nova-compute[73144]:   <os>
Aug 14 21:45:17 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:17 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:17 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:17 user nova-compute[73144]:   </os>
Aug 14 21:45:17 user nova-compute[73144]:   <features>
Aug 14 21:45:17 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:17 user nova-compute[73144]:     <apic/>
Aug 14 21:45:17 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:17 user nova-compute[73144]:   </features>
Aug 14 21:45:17 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:17 user nova-compute[73144]:   </clock>
Aug 14 21:45:17 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:17 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:17 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:17 user nova-compute[73144]:   </cpu>
Aug 14 21:45:17 user nova-compute[73144]:   <devices>
Aug 14 21:45:17 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:17 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:17 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk"/>
Aug 14 21:45:17 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:     </disk>
Aug 14 21:45:17 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:17 user nova-compute[73144]:       <mac address="fa:16:3e:74:a7:97"/>
Aug 14 21:45:17 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:17 user nova-compute[73144]:       <target dev="tap758cbe79-b4"/>
Aug 14 21:45:17 user nova-compute[73144]:     </interface>
Aug 14 21:45:17 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:17 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/console.log" append="off"/>
Aug 14 21:45:17 user nova-compute[73144]:     </serial>
Aug 14 21:45:17 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:17 user nova-compute[73144]:     <video>
Aug 14 21:45:17 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:     </video>
Aug 14 21:45:17 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:17 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:17 user nova-compute[73144]:     </rng>
Aug 14 21:45:17 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:17 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:17 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:17 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:17 user nova-compute[73144]:   </devices>
Aug 14 21:45:17 user nova-compute[73144]: </domain>
Aug 14 21:45:17 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG os_vif [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3637b061-93, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3637b061-93, col_values=(('external_ids', {'iface-id': '3637b061-93ae-454c-88ff-45478c8bdcda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:42:f6', 'vm-uuid': 'ae3ee52c-0811-4c67-a43e-736e02c5511d'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: INFO os_vif [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93')
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap758cbe79-b4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap758cbe79-b4, col_values=(('external_ids', {'iface-id': '758cbe79-b4b9-40b7-93a4-37b07664efb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:a7:97', 'vm-uuid': 'abb6bbee-268b-45c6-b3da-49ecc86944c0'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: INFO os_vif [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4')
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No VIF found with MAC fa:16:3e:31:42:f6, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Releasing lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Instance network_info: |[{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Start _get_guest_xml network_info=[{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No VIF found with MAC fa:16:3e:74:a7:97, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700950644',display_name='tempest-ServerActionsTestOtherA-server-700950644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700950644',id=6,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-2tb4xrds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=b38d8d04-d91a-49d3-9350-e44d2ba576cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:eb,bridge_name='br-int',has_traffic_filtering=True,id=2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf601dc-0a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'pci_devices' on Instance uuid b38d8d04-d91a-49d3-9350-e44d2ba576cf {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:17 user nova-compute[73144]:   <uuid>b38d8d04-d91a-49d3-9350-e44d2ba576cf</uuid>
Aug 14 21:45:17 user nova-compute[73144]:   <name>instance-00000006</name>
Aug 14 21:45:17 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:17 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:17 user nova-compute[73144]:   <metadata>
Aug 14 21:45:17 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:17 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:name>tempest-ServerActionsTestOtherA-server-700950644</nova:name>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:17</nova:creationTime>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:17 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:user uuid="f236788f6a93453b893ddf6d4cf01c1c">tempest-ServerActionsTestOtherA-202206255-project-member</nova:user>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:project uuid="fe2005f37baf4b1b99effc98fddd0fdc">tempest-ServerActionsTestOtherA-202206255</nova:project>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:17 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:17 user nova-compute[73144]:         <nova:port uuid="2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09">
Aug 14 21:45:17 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:45:17 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:17 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:17 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:17 user nova-compute[73144]:   </metadata>
Aug 14 21:45:17 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:17 user nova-compute[73144]:     <system>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="serial">b38d8d04-d91a-49d3-9350-e44d2ba576cf</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="uuid">b38d8d04-d91a-49d3-9350-e44d2ba576cf</entry>
Aug 14 21:45:17 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:17 user nova-compute[73144]:     </system>
Aug 14 21:45:17 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:17 user nova-compute[73144]:   <os>
Aug 14 21:45:17 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:17 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:17 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:17 user nova-compute[73144]:   </os>
Aug 14 21:45:17 user nova-compute[73144]:   <features>
Aug 14 21:45:17 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:17 user nova-compute[73144]:     <apic/>
Aug 14 21:45:17 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:17 user nova-compute[73144]:   </features>
Aug 14 21:45:17 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:17 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:17 user nova-compute[73144]:   </clock>
Aug 14 21:45:17 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:17 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:17 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:17 user nova-compute[73144]:   </cpu>
Aug 14 21:45:17 user nova-compute[73144]:   <devices>
Aug 14 21:45:17 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:17 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:17 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk"/>
Aug 14 21:45:17 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:     </disk>
Aug 14 21:45:17 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:17 user nova-compute[73144]:       <mac address="fa:16:3e:38:87:eb"/>
Aug 14 21:45:17 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:17 user nova-compute[73144]:       <target dev="tap2cf601dc-0a"/>
Aug 14 21:45:17 user nova-compute[73144]:     </interface>
Aug 14 21:45:17 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:17 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/console.log" append="off"/>
Aug 14 21:45:17 user nova-compute[73144]:     </serial>
Aug 14 21:45:17 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:17 user nova-compute[73144]:     <video>
Aug 14 21:45:17 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:17 user nova-compute[73144]:     </video>
Aug 14 21:45:17 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:17 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:17 user nova-compute[73144]:     </rng>
Aug 14 21:45:17 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:17 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:17 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:17 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:17 user nova-compute[73144]:   </devices>
Aug 14 21:45:17 user nova-compute[73144]: </domain>
Aug 14 21:45:17 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700950644',display_name='tempest-ServerActionsTestOtherA-server-700950644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700950644',id=6,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-2tb4xrds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=b38d8d04-d91a-49d3-9350-e44d2ba576cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:eb,bridge_name='br-int',has_traffic_filtering=True,id=2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf601dc-0a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG os_vif [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:eb,bridge_name='br-int',has_traffic_filtering=True,id=2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf601dc-0a') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cf601dc-0a, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cf601dc-0a, col_values=(('external_ids', {'iface-id': '2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:87:eb', 'vm-uuid': 'b38d8d04-d91a-49d3-9350-e44d2ba576cf'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: INFO os_vif [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:eb,bridge_name='br-int',has_traffic_filtering=True,id=2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf601dc-0a')
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No VIF found with MAC fa:16:3e:38:87:eb, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-changed-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Refreshing instance network info cache due to event network-changed-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] Acquiring lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] Acquired lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Refreshing network info cache for port 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG nova.network.neutron [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updated VIF entry in instance network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG nova.network.neutron [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6f238852-2e80-445b-a911-411a2f18884c req-5f878630-9eec-4ef8-b127-e46a4b4bfe30 service nova] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.network.neutron [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updated VIF entry in instance network info cache for port 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.network.neutron [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-15326d8d-8cff-47e0-899e-4e85cfce7784 req-0373ac9d-a93b-46b7-9f92-78ef0caae72d service nova] Releasing lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.network.neutron [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updated VIF entry in instance network info cache for port 758cbe79-b4b9-40b7-93a4-37b07664efb4. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.network.neutron [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e9811756-0ff9-48ea-a823-7f04f58ef1b5 req-ce77498b-a8e9-4892-8f6c-645c45859c70 service nova] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:19 user nova-compute[73144]: WARNING nova.compute.manager [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state building and task_state spawning.
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:19 user nova-compute[73144]: WARNING nova.compute.manager [req-5b2c94fd-a907-4a9f-9b49-4645c162c9ee req-3cecd789-aa80-4ca4-afa7-6ae7b6c85e67 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state building and task_state spawning.
Aug 14 21:45:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-318e4168-0853-4318-9554-09094b4c0e92 req-09f2a58a-6256-468f-9267-d459e2b27593 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-318e4168-0853-4318-9554-09094b4c0e92 req-09f2a58a-6256-468f-9267-d459e2b27593 service nova] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-318e4168-0853-4318-9554-09094b4c0e92 req-09f2a58a-6256-468f-9267-d459e2b27593 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-318e4168-0853-4318-9554-09094b4c0e92 req-09f2a58a-6256-468f-9267-d459e2b27593 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-318e4168-0853-4318-9554-09094b4c0e92 req-09f2a58a-6256-468f-9267-d459e2b27593 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] No waiting events found dispatching network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:22 user nova-compute[73144]: WARNING nova.compute.manager [req-318e4168-0853-4318-9554-09094b4c0e92 req-09f2a58a-6256-468f-9267-d459e2b27593 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received unexpected event network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 for instance with vm_state building and task_state spawning.
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049524.0030723, c16f9e34-3fc2-49c7-b0b8-99c5e5153818 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] VM Resumed (Lifecycle Event)
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.claims [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Claim successful on node user
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Instance spawned successfully.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049524.004363, c16f9e34-3fc2-49c7-b0b8-99c5e5153818 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] VM Started (Lifecycle Event)
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-1e944f38-7c84-4977-a03d-c50267c6bcfa req-bfe4fe80-3480-473d-a3c0-fa84e9aa26d6 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1e944f38-7c84-4977-a03d-c50267c6bcfa req-bfe4fe80-3480-473d-a3c0-fa84e9aa26d6 service nova] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1e944f38-7c84-4977-a03d-c50267c6bcfa req-bfe4fe80-3480-473d-a3c0-fa84e9aa26d6 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1e944f38-7c84-4977-a03d-c50267c6bcfa req-bfe4fe80-3480-473d-a3c0-fa84e9aa26d6 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-1e944f38-7c84-4977-a03d-c50267c6bcfa req-bfe4fe80-3480-473d-a3c0-fa84e9aa26d6 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] No waiting events found dispatching network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:24 user nova-compute[73144]: WARNING nova.compute.manager [req-1e944f38-7c84-4977-a03d-c50267c6bcfa req-bfe4fe80-3480-473d-a3c0-fa84e9aa26d6 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received unexpected event network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 for instance with vm_state building and task_state spawning.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Took 17.46 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049524.3899047, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Resumed (Lifecycle Event)
Aug 14 21:45:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Took 18.32 seconds to build instance.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance spawned successfully.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1862525-c5ca-4e69-a8a8-8f1f1f2effa4 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.488s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049524.3901982, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Started (Lifecycle Event)
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 5.280s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:24 user nova-compute[73144]: INFO nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Took 16.29 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:25 user nova-compute[73144]: INFO nova.compute.manager [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Took 17.20 seconds to build instance.
Aug 14 21:45:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d3e3f966-a85e-4dd3-8a65-bd61dec9589f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.353s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG nova.policy [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '894a50b95060455fb7702b1216f2adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea8cc08442546c29ea4a251995ea832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Creating image(s)
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "/opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "/opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "/opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.261s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.301s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk 1073741824" returned: 0 in 0.082s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049526.1232686, b38d8d04-d91a-49d3-9350-e44d2ba576cf => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] VM Resumed (Lifecycle Event)
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Instance spawned successfully.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance spawned successfully.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.272s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049526.1526961, b38d8d04-d91a-49d3-9350-e44d2ba576cf => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] VM Started (Lifecycle Event)
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance spawned successfully.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Took 15.57 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049526.1678088, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Resumed (Lifecycle Event)
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Successfully created port: 1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Cannot resize image /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'migration_context' on Instance uuid 4583cc14-41a8-46b7-85d5-440efba5ec4f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Took 17.10 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Ensure instance console log exists: /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049526.1728559, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Started (Lifecycle Event)
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Took 19.10 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049526.4360433, ae3ee52c-0811-4c67-a43e-736e02c5511d => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] VM Resumed (Lifecycle Event)
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Took 20.16 seconds to build instance.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Took 17.00 seconds to build instance.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049526.4393415, ae3ee52c-0811-4c67-a43e-736e02c5511d => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] VM Started (Lifecycle Event)
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0743a41-49d7-45b5-b86d-0fb191dfae82 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.356s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:26 user nova-compute[73144]: INFO nova.compute.manager [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Took 18.25 seconds to build instance.
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c6203f3-79a5-4cef-bf87-c276dd44273c tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.234s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcb6270b-5f68-4441-9e17-17395e3ef3d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.497s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Successfully updated port: 1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquired lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-changed-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Refreshing instance network info cache due to event network-changed-1850f048-e688-4549-94c2-99033fbe1eae. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] Acquiring lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Updating instance_info_cache with network_info: [{"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Releasing lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Instance network_info: |[{"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] Acquired lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Refreshing network info cache for port 1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Start _get_guest_xml network_info=[{"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:30 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:30 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1135813681',display_name='tempest-VolumesAdminNegativeTest-server-1135813681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1135813681',id=7,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMn7xEfatAyEc5nZ4EwHUn3JLvQQ+5NlAKyjrS49au1PMEou6puK5b5erpNT60rKBOaAK5Gotr4BDHMPfolu0IXjfGfDIhJ4Zd3lHVv3yMXwPBwN4T007SoJ4fXHthOKA==',key_name='tempest-keypair-1784913599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ea8cc08442546c29ea4a251995ea832',ramdisk_id='',reservation_id='r-uuklczhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-177118256',owner_user_name='tempest-VolumesAdminNegativeTest-177118256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='894a50b95060455fb7702b1216f2adf4',uuid=4583cc14-41a8-46b7-85d5-440efba5ec4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converting VIF {"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:59,bridge_name='br-int',has_traffic_filtering=True,id=1850f048-e688-4549-94c2-99033fbe1eae,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1850f048-e6') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.objects.instance [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'pci_devices' on Instance uuid 4583cc14-41a8-46b7-85d5-440efba5ec4f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:30 user nova-compute[73144]:   <uuid>4583cc14-41a8-46b7-85d5-440efba5ec4f</uuid>
Aug 14 21:45:30 user nova-compute[73144]:   <name>instance-00000007</name>
Aug 14 21:45:30 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:30 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:30 user nova-compute[73144]:   <metadata>
Aug 14 21:45:30 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:30 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:30 user nova-compute[73144]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1135813681</nova:name>
Aug 14 21:45:30 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:30</nova:creationTime>
Aug 14 21:45:30 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:30 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:30 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:30 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:30 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:30 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:30 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:30 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:30 user nova-compute[73144]:         <nova:user uuid="894a50b95060455fb7702b1216f2adf4">tempest-VolumesAdminNegativeTest-177118256-project-member</nova:user>
Aug 14 21:45:30 user nova-compute[73144]:         <nova:project uuid="7ea8cc08442546c29ea4a251995ea832">tempest-VolumesAdminNegativeTest-177118256</nova:project>
Aug 14 21:45:30 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:30 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:30 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:30 user nova-compute[73144]:         <nova:port uuid="1850f048-e688-4549-94c2-99033fbe1eae">
Aug 14 21:45:30 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:45:30 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:30 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:30 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:30 user nova-compute[73144]:   </metadata>
Aug 14 21:45:30 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:30 user nova-compute[73144]:     <system>
Aug 14 21:45:30 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:30 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:30 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:30 user nova-compute[73144]:       <entry name="serial">4583cc14-41a8-46b7-85d5-440efba5ec4f</entry>
Aug 14 21:45:30 user nova-compute[73144]:       <entry name="uuid">4583cc14-41a8-46b7-85d5-440efba5ec4f</entry>
Aug 14 21:45:30 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:30 user nova-compute[73144]:     </system>
Aug 14 21:45:30 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:30 user nova-compute[73144]:   <os>
Aug 14 21:45:30 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:30 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:30 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:30 user nova-compute[73144]:   </os>
Aug 14 21:45:30 user nova-compute[73144]:   <features>
Aug 14 21:45:30 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:30 user nova-compute[73144]:     <apic/>
Aug 14 21:45:30 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:30 user nova-compute[73144]:   </features>
Aug 14 21:45:30 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:30 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:30 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:30 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:30 user nova-compute[73144]:   </clock>
Aug 14 21:45:30 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:30 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:30 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:30 user nova-compute[73144]:   </cpu>
Aug 14 21:45:30 user nova-compute[73144]:   <devices>
Aug 14 21:45:30 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:30 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:30 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk"/>
Aug 14 21:45:30 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:30 user nova-compute[73144]:     </disk>
Aug 14 21:45:30 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:30 user nova-compute[73144]:       <mac address="fa:16:3e:60:39:59"/>
Aug 14 21:45:30 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:30 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:30 user nova-compute[73144]:       <target dev="tap1850f048-e6"/>
Aug 14 21:45:30 user nova-compute[73144]:     </interface>
Aug 14 21:45:30 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:30 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/console.log" append="off"/>
Aug 14 21:45:30 user nova-compute[73144]:     </serial>
Aug 14 21:45:30 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:30 user nova-compute[73144]:     <video>
Aug 14 21:45:30 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:30 user nova-compute[73144]:     </video>
Aug 14 21:45:30 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:30 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:30 user nova-compute[73144]:     </rng>
Aug 14 21:45:30 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:30 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:30 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:30 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:30 user nova-compute[73144]:   </devices>
Aug 14 21:45:30 user nova-compute[73144]: </domain>
Aug 14 21:45:30 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1135813681',display_name='tempest-VolumesAdminNegativeTest-server-1135813681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1135813681',id=7,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMn7xEfatAyEc5nZ4EwHUn3JLvQQ+5NlAKyjrS49au1PMEou6puK5b5erpNT60rKBOaAK5Gotr4BDHMPfolu0IXjfGfDIhJ4Zd3lHVv3yMXwPBwN4T007SoJ4fXHthOKA==',key_name='tempest-keypair-1784913599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ea8cc08442546c29ea4a251995ea832',ramdisk_id='',reservation_id='r-uuklczhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-177118256',owner_user_name='tempest-VolumesAdminNegativeTest-177118256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='894a50b95060455fb7702b1216f2adf4',uuid=4583cc14-41a8-46b7-85d5-440efba5ec4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converting VIF {"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:59,bridge_name='br-int',has_traffic_filtering=True,id=1850f048-e688-4549-94c2-99033fbe1eae,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1850f048-e6') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG os_vif [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:59,bridge_name='br-int',has_traffic_filtering=True,id=1850f048-e688-4549-94c2-99033fbe1eae,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1850f048-e6') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1850f048-e6, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1850f048-e6, col_values=(('external_ids', {'iface-id': '1850f048-e688-4549-94c2-99033fbe1eae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:39:59', 'vm-uuid': '4583cc14-41a8-46b7-85d5-440efba5ec4f'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:30 user nova-compute[73144]: INFO os_vif [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:59,bridge_name='br-int',has_traffic_filtering=True,id=1850f048-e688-4549-94c2-99033fbe1eae,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1850f048-e6')
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] No VIF found with MAC fa:16:3e:60:39:59, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:31 user nova-compute[73144]: WARNING nova.compute.manager [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state active and task_state None.
Aug 14 21:45:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:31 user nova-compute[73144]: WARNING nova.compute.manager [req-f9196e84-1074-4731-8c4c-72e42e0c156b req-8640cd81-b7d1-4c39-8dd9-74de39a10f2c service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state active and task_state None.
Aug 14 21:45:32 user nova-compute[73144]: DEBUG nova.network.neutron [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Updated VIF entry in instance network info cache for port 1850f048-e688-4549-94c2-99033fbe1eae. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:32 user nova-compute[73144]: DEBUG nova.network.neutron [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Updating instance_info_cache with network_info: [{"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a33a1b6-9145-470c-83fa-92c9b06abd30 req-01ef5199-e516-44e1-b5ef-30a315602892 service nova] Releasing lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:35 user nova-compute[73144]: INFO nova.compute.claims [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Claim successful on node user
Aug 14 21:45:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049535.8709579, 4583cc14-41a8-46b7-85d5-440efba5ec4f => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] VM Resumed (Lifecycle Event)
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Instance spawned successfully.
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:35 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049535.871042, 4583cc14-41a8-46b7-85d5-440efba5ec4f => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] VM Started (Lifecycle Event)
Aug 14 21:45:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:36 user nova-compute[73144]: INFO nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Took 10.92 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:36 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.026s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.053s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:36 user nova-compute[73144]: INFO nova.compute.claims [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Claim successful on node user
Aug 14 21:45:36 user nova-compute[73144]: INFO nova.compute.manager [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Took 16.80 seconds to build instance.
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.network.neutron [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-81ea5cb3-363d-4743-9f5a-ad08921a864b tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.935s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:36 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:36 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Creating image(s)
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "/opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "/opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "/opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG nova.policy [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ee9862d25eb4fa1b7eae15b7770f60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b26313e6174cdb9cc7461661811382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.304s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.309s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.159s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk 1073741824" returned: 0 in 0.062s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.377s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Successfully created port: c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.298s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.policy [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '758cb24fe4344f67afa1a67f6d4c0207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0371933d14425d94c4b4128befd645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Creating image(s)
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "/opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "/opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "/opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Cannot resize image /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.objects.instance [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lazy-loading 'migration_context' on Instance uuid e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Ensure instance console log exists: /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.343s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.242s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.network.neutron [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Successfully updated port: c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk 1073741824" returned: 0 in 0.081s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquired lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.network.neutron [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-changed-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Refreshing instance network info cache due to event network-changed-c83f2c59-138d-492d-a724-3cd6fdb2dbaf. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] Acquiring lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.network.neutron [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.255s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.371s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Cannot resize image /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lazy-loading 'migration_context' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Ensure instance console log exists: /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Updating instance_info_cache with network_info: [{"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Releasing lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Instance network_info: |[{"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] Acquired lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Refreshing network info cache for port c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Start _get_guest_xml network_info=[{"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:39 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:39 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-573106279',display_name='tempest-VolumesAssistedSnapshotsTest-server-573106279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-573106279',id=8,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM8lbDI94TQ/etw9iA55fLXxSz2Gr6e4uXmSdNhXGaYoof/PejXCzbhb7d8paEiOc3I3ueWNrTrVa13NMs7ng8GxHkZmu2TEpG+jr6k9KeJ1ZGgz4c+UCOoYK0rn4f+3g==',key_name='tempest-keypair-575572244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b26313e6174cdb9cc7461661811382',ramdisk_id='',reservation_id='r-u1fus3v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1184426792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1184426792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee9862d25eb4fa1b7eae15b7770f60d',uuid=e522c4f9-2830-4f29-9c1c-17425af77440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Converting VIF {"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:80:0a,bridge_name='br-int',has_traffic_filtering=True,id=c83f2c59-138d-492d-a724-3cd6fdb2dbaf,network=Network(8d0bd10e-1f55-4999-b6f1-63aaa8366aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83f2c59-13') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.objects.instance [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lazy-loading 'pci_devices' on Instance uuid e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:39 user nova-compute[73144]:   <uuid>e522c4f9-2830-4f29-9c1c-17425af77440</uuid>
Aug 14 21:45:39 user nova-compute[73144]:   <name>instance-00000008</name>
Aug 14 21:45:39 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:39 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:39 user nova-compute[73144]:   <metadata>
Aug 14 21:45:39 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:39 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:39 user nova-compute[73144]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-573106279</nova:name>
Aug 14 21:45:39 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:39</nova:creationTime>
Aug 14 21:45:39 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:39 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:39 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:39 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:39 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:39 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:39 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:39 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:39 user nova-compute[73144]:         <nova:user uuid="3ee9862d25eb4fa1b7eae15b7770f60d">tempest-VolumesAssistedSnapshotsTest-1184426792-project-member</nova:user>
Aug 14 21:45:39 user nova-compute[73144]:         <nova:project uuid="66b26313e6174cdb9cc7461661811382">tempest-VolumesAssistedSnapshotsTest-1184426792</nova:project>
Aug 14 21:45:39 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:39 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:39 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:39 user nova-compute[73144]:         <nova:port uuid="c83f2c59-138d-492d-a724-3cd6fdb2dbaf">
Aug 14 21:45:39 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 21:45:39 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:39 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:39 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:39 user nova-compute[73144]:   </metadata>
Aug 14 21:45:39 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:39 user nova-compute[73144]:     <system>
Aug 14 21:45:39 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:39 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:39 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:39 user nova-compute[73144]:       <entry name="serial">e522c4f9-2830-4f29-9c1c-17425af77440</entry>
Aug 14 21:45:39 user nova-compute[73144]:       <entry name="uuid">e522c4f9-2830-4f29-9c1c-17425af77440</entry>
Aug 14 21:45:39 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:39 user nova-compute[73144]:     </system>
Aug 14 21:45:39 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:39 user nova-compute[73144]:   <os>
Aug 14 21:45:39 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:39 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:39 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:39 user nova-compute[73144]:   </os>
Aug 14 21:45:39 user nova-compute[73144]:   <features>
Aug 14 21:45:39 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:39 user nova-compute[73144]:     <apic/>
Aug 14 21:45:39 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:39 user nova-compute[73144]:   </features>
Aug 14 21:45:39 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:39 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:39 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:39 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:39 user nova-compute[73144]:   </clock>
Aug 14 21:45:39 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:39 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:39 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:39 user nova-compute[73144]:   </cpu>
Aug 14 21:45:39 user nova-compute[73144]:   <devices>
Aug 14 21:45:39 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:39 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:39 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk"/>
Aug 14 21:45:39 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:39 user nova-compute[73144]:     </disk>
Aug 14 21:45:39 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:39 user nova-compute[73144]:       <mac address="fa:16:3e:58:80:0a"/>
Aug 14 21:45:39 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:39 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:39 user nova-compute[73144]:       <target dev="tapc83f2c59-13"/>
Aug 14 21:45:39 user nova-compute[73144]:     </interface>
Aug 14 21:45:39 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:39 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/console.log" append="off"/>
Aug 14 21:45:39 user nova-compute[73144]:     </serial>
Aug 14 21:45:39 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:39 user nova-compute[73144]:     <video>
Aug 14 21:45:39 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:39 user nova-compute[73144]:     </video>
Aug 14 21:45:39 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:39 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:39 user nova-compute[73144]:     </rng>
Aug 14 21:45:39 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:39 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:39 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:39 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:39 user nova-compute[73144]:   </devices>
Aug 14 21:45:39 user nova-compute[73144]: </domain>
Aug 14 21:45:39 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-573106279',display_name='tempest-VolumesAssistedSnapshotsTest-server-573106279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-573106279',id=8,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM8lbDI94TQ/etw9iA55fLXxSz2Gr6e4uXmSdNhXGaYoof/PejXCzbhb7d8paEiOc3I3ueWNrTrVa13NMs7ng8GxHkZmu2TEpG+jr6k9KeJ1ZGgz4c+UCOoYK0rn4f+3g==',key_name='tempest-keypair-575572244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b26313e6174cdb9cc7461661811382',ramdisk_id='',reservation_id='r-u1fus3v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1184426792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1184426792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee9862d25eb4fa1b7eae15b7770f60d',uuid=e522c4f9-2830-4f29-9c1c-17425af77440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Converting VIF {"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:80:0a,bridge_name='br-int',has_traffic_filtering=True,id=c83f2c59-138d-492d-a724-3cd6fdb2dbaf,network=Network(8d0bd10e-1f55-4999-b6f1-63aaa8366aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83f2c59-13') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG os_vif [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:80:0a,bridge_name='br-int',has_traffic_filtering=True,id=c83f2c59-138d-492d-a724-3cd6fdb2dbaf,network=Network(8d0bd10e-1f55-4999-b6f1-63aaa8366aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83f2c59-13') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83f2c59-13, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc83f2c59-13, col_values=(('external_ids', {'iface-id': 'c83f2c59-138d-492d-a724-3cd6fdb2dbaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:80:0a', 'vm-uuid': 'e522c4f9-2830-4f29-9c1c-17425af77440'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:39 user nova-compute[73144]: INFO os_vif [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:80:0a,bridge_name='br-int',has_traffic_filtering=True,id=c83f2c59-138d-492d-a724-3cd6fdb2dbaf,network=Network(8d0bd10e-1f55-4999-b6f1-63aaa8366aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83f2c59-13')
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Successfully created port: e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] No VIF found with MAC fa:16:3e:58:80:0a, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Updated VIF entry in instance network info cache for port c83f2c59-138d-492d-a724-3cd6fdb2dbaf. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Updating instance_info_cache with network_info: [{"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-223fc95e-879d-4321-874d-f46fb702560b req-f0b88086-583b-469b-bb4c-93cd8686a954 service nova] Releasing lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Successfully updated port: e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquired lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-changed-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Refreshing instance network info cache due to event network-changed-e1162aba-89af-461b-bd63-7c862dfd9095. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] Acquiring lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:40 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Updating instance_info_cache with network_info: [{"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Releasing lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Instance network_info: |[{"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] Acquired lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.network.neutron [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Refreshing network info cache for port e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Start _get_guest_xml network_info=[{"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:41 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:41 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-147715936',display_name='tempest-TestVolumeSwap-server-147715936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-147715936',id=9,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhjm3SZh4W9vTa5BY+dRz7S7VY0336FseML/QOH74MZIYnJoW4Q/5SQuQOrMSDY+dZP4VmNYar5lC4vXn6EYVldUH2gcfbSGkFabNkMkAyCDjDrwMjxxcWEYsRZ6aSQCA==',key_name='tempest-keypair-618409022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0371933d14425d94c4b4128befd645',ramdisk_id='',reservation_id='r-re6fec1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1557453863',owner_user_name='tempest-TestVolumeSwap-1557453863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758cb24fe4344f67afa1a67f6d4c0207',uuid=97bb9730-6643-4fa6-be15-05c6f920b2db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Converting VIF {"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:1a,bridge_name='br-int',has_traffic_filtering=True,id=e1162aba-89af-461b-bd63-7c862dfd9095,network=Network(0da3f902-04a3-4384-b718-7f476ce56db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1162aba-89') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lazy-loading 'pci_devices' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:41 user nova-compute[73144]:   <uuid>97bb9730-6643-4fa6-be15-05c6f920b2db</uuid>
Aug 14 21:45:41 user nova-compute[73144]:   <name>instance-00000009</name>
Aug 14 21:45:41 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:41 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:41 user nova-compute[73144]:   <metadata>
Aug 14 21:45:41 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:41 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:41 user nova-compute[73144]:       <nova:name>tempest-TestVolumeSwap-server-147715936</nova:name>
Aug 14 21:45:41 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:41</nova:creationTime>
Aug 14 21:45:41 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:41 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:41 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:41 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:41 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:41 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:41 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:41 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:41 user nova-compute[73144]:         <nova:user uuid="758cb24fe4344f67afa1a67f6d4c0207">tempest-TestVolumeSwap-1557453863-project-member</nova:user>
Aug 14 21:45:41 user nova-compute[73144]:         <nova:project uuid="0b0371933d14425d94c4b4128befd645">tempest-TestVolumeSwap-1557453863</nova:project>
Aug 14 21:45:41 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:41 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:41 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:41 user nova-compute[73144]:         <nova:port uuid="e1162aba-89af-461b-bd63-7c862dfd9095">
Aug 14 21:45:41 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 21:45:41 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:41 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:41 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:41 user nova-compute[73144]:   </metadata>
Aug 14 21:45:41 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:41 user nova-compute[73144]:     <system>
Aug 14 21:45:41 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:41 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:41 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:41 user nova-compute[73144]:       <entry name="serial">97bb9730-6643-4fa6-be15-05c6f920b2db</entry>
Aug 14 21:45:41 user nova-compute[73144]:       <entry name="uuid">97bb9730-6643-4fa6-be15-05c6f920b2db</entry>
Aug 14 21:45:41 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:41 user nova-compute[73144]:     </system>
Aug 14 21:45:41 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:41 user nova-compute[73144]:   <os>
Aug 14 21:45:41 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:41 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:41 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:41 user nova-compute[73144]:   </os>
Aug 14 21:45:41 user nova-compute[73144]:   <features>
Aug 14 21:45:41 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:41 user nova-compute[73144]:     <apic/>
Aug 14 21:45:41 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:41 user nova-compute[73144]:   </features>
Aug 14 21:45:41 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:41 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:41 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:41 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:41 user nova-compute[73144]:   </clock>
Aug 14 21:45:41 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:41 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:41 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:41 user nova-compute[73144]:   </cpu>
Aug 14 21:45:41 user nova-compute[73144]:   <devices>
Aug 14 21:45:41 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:41 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:41 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk"/>
Aug 14 21:45:41 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:41 user nova-compute[73144]:     </disk>
Aug 14 21:45:41 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:41 user nova-compute[73144]:       <mac address="fa:16:3e:a9:cf:1a"/>
Aug 14 21:45:41 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:41 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:41 user nova-compute[73144]:       <target dev="tape1162aba-89"/>
Aug 14 21:45:41 user nova-compute[73144]:     </interface>
Aug 14 21:45:41 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:41 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/console.log" append="off"/>
Aug 14 21:45:41 user nova-compute[73144]:     </serial>
Aug 14 21:45:41 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:41 user nova-compute[73144]:     <video>
Aug 14 21:45:41 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:41 user nova-compute[73144]:     </video>
Aug 14 21:45:41 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:41 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:41 user nova-compute[73144]:     </rng>
Aug 14 21:45:41 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:41 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:41 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:41 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:41 user nova-compute[73144]:   </devices>
Aug 14 21:45:41 user nova-compute[73144]: </domain>
Aug 14 21:45:41 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-147715936',display_name='tempest-TestVolumeSwap-server-147715936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-147715936',id=9,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhjm3SZh4W9vTa5BY+dRz7S7VY0336FseML/QOH74MZIYnJoW4Q/5SQuQOrMSDY+dZP4VmNYar5lC4vXn6EYVldUH2gcfbSGkFabNkMkAyCDjDrwMjxxcWEYsRZ6aSQCA==',key_name='tempest-keypair-618409022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0371933d14425d94c4b4128befd645',ramdisk_id='',reservation_id='r-re6fec1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1557453863',owner_user_name='tempest-TestVolumeSwap-1557453863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758cb24fe4344f67afa1a67f6d4c0207',uuid=97bb9730-6643-4fa6-be15-05c6f920b2db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Converting VIF {"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:1a,bridge_name='br-int',has_traffic_filtering=True,id=e1162aba-89af-461b-bd63-7c862dfd9095,network=Network(0da3f902-04a3-4384-b718-7f476ce56db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1162aba-89') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG os_vif [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:1a,bridge_name='br-int',has_traffic_filtering=True,id=e1162aba-89af-461b-bd63-7c862dfd9095,network=Network(0da3f902-04a3-4384-b718-7f476ce56db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1162aba-89') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1162aba-89, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1162aba-89, col_values=(('external_ids', {'iface-id': 'e1162aba-89af-461b-bd63-7c862dfd9095', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:cf:1a', 'vm-uuid': '97bb9730-6643-4fa6-be15-05c6f920b2db'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:41 user nova-compute[73144]: INFO os_vif [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:1a,bridge_name='br-int',has_traffic_filtering=True,id=e1162aba-89af-461b-bd63-7c862dfd9095,network=Network(0da3f902-04a3-4384-b718-7f476ce56db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1162aba-89')
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] No VIF found with MAC fa:16:3e:a9:cf:1a, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Updated VIF entry in instance network info cache for port e1162aba-89af-461b-bd63-7c862dfd9095. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Updating instance_info_cache with network_info: [{"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ebedf27d-0a64-44ac-a931-cd7dbf42ece1 req-873f3e09-4464-4e09-ae7c-202850225bc1 service nova] Releasing lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-7c8272a0-2f6f-4c6a-80ab-01f3c69d9e38 req-fc81b231-3688-4e4b-ad8f-2d3666afcb6b service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7c8272a0-2f6f-4c6a-80ab-01f3c69d9e38 req-fc81b231-3688-4e4b-ad8f-2d3666afcb6b service nova] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7c8272a0-2f6f-4c6a-80ab-01f3c69d9e38 req-fc81b231-3688-4e4b-ad8f-2d3666afcb6b service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7c8272a0-2f6f-4c6a-80ab-01f3c69d9e38 req-fc81b231-3688-4e4b-ad8f-2d3666afcb6b service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-7c8272a0-2f6f-4c6a-80ab-01f3c69d9e38 req-fc81b231-3688-4e4b-ad8f-2d3666afcb6b service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] No waiting events found dispatching network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:44 user nova-compute[73144]: WARNING nova.compute.manager [req-7c8272a0-2f6f-4c6a-80ab-01f3c69d9e38 req-fc81b231-3688-4e4b-ad8f-2d3666afcb6b service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received unexpected event network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 for instance with vm_state building and task_state spawning.
Aug 14 21:45:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049546.4133823, e522c4f9-2830-4f29-9c1c-17425af77440 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] VM Resumed (Lifecycle Event)
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Instance spawned successfully.
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049546.4149804, e522c4f9-2830-4f29-9c1c-17425af77440 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] VM Started (Lifecycle Event)
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Took 9.85 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-1c8a270b-861e-4f0e-8d74-06766075c8fe req-2a9ce668-e520-4b56-8f49-b1cb183ae495 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1c8a270b-861e-4f0e-8d74-06766075c8fe req-2a9ce668-e520-4b56-8f49-b1cb183ae495 service nova] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1c8a270b-861e-4f0e-8d74-06766075c8fe req-2a9ce668-e520-4b56-8f49-b1cb183ae495 service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1c8a270b-861e-4f0e-8d74-06766075c8fe req-2a9ce668-e520-4b56-8f49-b1cb183ae495 service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-1c8a270b-861e-4f0e-8d74-06766075c8fe req-2a9ce668-e520-4b56-8f49-b1cb183ae495 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] No waiting events found dispatching network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:46 user nova-compute[73144]: WARNING nova.compute.manager [req-1c8a270b-861e-4f0e-8d74-06766075c8fe req-2a9ce668-e520-4b56-8f49-b1cb183ae495 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received unexpected event network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 for instance with vm_state building and task_state spawning.
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Took 11.50 seconds to build instance.
Aug 14 21:45:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-19df092f-8606-469a-8386-0a395aa0fddc tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.702s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049546.8255012, 97bb9730-6643-4fa6-be15-05c6f920b2db => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] VM Resumed (Lifecycle Event)
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Instance spawned successfully.
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:46 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049546.8322837, 97bb9730-6643-4fa6-be15-05c6f920b2db => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] VM Started (Lifecycle Event)
Aug 14 21:45:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:47 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:47 user nova-compute[73144]: INFO nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Took 9.12 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:47 user nova-compute[73144]: INFO nova.compute.manager [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Took 11.07 seconds to build instance.
Aug 14 21:45:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ccb7761e-d61c-40b1-a743-92d6d24c919c tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.412s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:48 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:45:48 user nova-compute[73144]: INFO nova.compute.claims [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Claim successful on node user
Aug 14 21:45:49 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:49 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.776s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:45:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:45:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:45:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:45:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:45:49 user nova-compute[73144]: DEBUG nova.policy [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df1eea89fe1a4c86b975e25b0396c1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0c2aa06bc45b08fccb6f18c12c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:45:50 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Creating image(s)
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "/opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "/opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.220s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.240s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk 1073741824" returned: 0 in 0.069s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.230s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:45:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Cannot resize image /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG nova.objects.instance [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lazy-loading 'migration_context' on Instance uuid 3c176f40-fc9b-4b76-8bbb-5aaebc494599 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Ensure instance console log exists: /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG nova.network.neutron [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Successfully created port: b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:51 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Successfully updated port: b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "refresh_cache-3c176f40-fc9b-4b76-8bbb-5aaebc494599" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquired lock "refresh_cache-3c176f40-fc9b-4b76-8bbb-5aaebc494599" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received event network-changed-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Refreshing instance network info cache due to event network-changed-b9bf4874-52b4-4f3f-8f07-debfa604caef. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] Acquiring lock "refresh_cache-3c176f40-fc9b-4b76-8bbb-5aaebc494599" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-8f3006b0-d27b-44e4-a5c6-b9fb31307683 req-2af16ffc-a7ce-443a-87ba-49b0c33c5862 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8f3006b0-d27b-44e4-a5c6-b9fb31307683 req-2af16ffc-a7ce-443a-87ba-49b0c33c5862 service nova] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8f3006b0-d27b-44e4-a5c6-b9fb31307683 req-2af16ffc-a7ce-443a-87ba-49b0c33c5862 service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8f3006b0-d27b-44e4-a5c6-b9fb31307683 req-2af16ffc-a7ce-443a-87ba-49b0c33c5862 service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-8f3006b0-d27b-44e4-a5c6-b9fb31307683 req-2af16ffc-a7ce-443a-87ba-49b0c33c5862 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] No waiting events found dispatching network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:52 user nova-compute[73144]: WARNING nova.compute.manager [req-8f3006b0-d27b-44e4-a5c6-b9fb31307683 req-2af16ffc-a7ce-443a-87ba-49b0c33c5862 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received unexpected event network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 for instance with vm_state active and task_state None.
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.network.neutron [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Updating instance_info_cache with network_info: [{"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Releasing lock "refresh_cache-3c176f40-fc9b-4b76-8bbb-5aaebc494599" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Instance network_info: |[{"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] Acquired lock "refresh_cache-3c176f40-fc9b-4b76-8bbb-5aaebc494599" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.network.neutron [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Refreshing network info cache for port b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Start _get_guest_xml network_info=[{"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:53 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:53 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2012080635',display_name='tempest-VolumesActionsTest-instance-2012080635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2012080635',id=10,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb0c2aa06bc45b08fccb6f18c12c67f',ramdisk_id='',reservation_id='r-mehdw77w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1332231170',owner_user_name='tempest-VolumesActionsTest-1332231170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:50Z,user_data=None,user_id='df1eea89fe1a4c86b975e25b0396c1a0',uuid=3c176f40-fc9b-4b76-8bbb-5aaebc494599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Converting VIF {"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:67:18,bridge_name='br-int',has_traffic_filtering=True,id=b9bf4874-52b4-4f3f-8f07-debfa604caef,network=Network(92ea8945-5343-406f-8aa4-ad39548593e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bf4874-52') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.objects.instance [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c176f40-fc9b-4b76-8bbb-5aaebc494599 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:45:53 user nova-compute[73144]:   <uuid>3c176f40-fc9b-4b76-8bbb-5aaebc494599</uuid>
Aug 14 21:45:53 user nova-compute[73144]:   <name>instance-0000000a</name>
Aug 14 21:45:53 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:45:53 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:45:53 user nova-compute[73144]:   <metadata>
Aug 14 21:45:53 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:45:53 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:45:53 user nova-compute[73144]:       <nova:name>tempest-VolumesActionsTest-instance-2012080635</nova:name>
Aug 14 21:45:53 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:45:53</nova:creationTime>
Aug 14 21:45:53 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:45:53 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:45:53 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:45:53 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:45:53 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:45:53 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:45:53 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:45:53 user nova-compute[73144]:       <nova:owner>
Aug 14 21:45:53 user nova-compute[73144]:         <nova:user uuid="df1eea89fe1a4c86b975e25b0396c1a0">tempest-VolumesActionsTest-1332231170-project-member</nova:user>
Aug 14 21:45:53 user nova-compute[73144]:         <nova:project uuid="0bb0c2aa06bc45b08fccb6f18c12c67f">tempest-VolumesActionsTest-1332231170</nova:project>
Aug 14 21:45:53 user nova-compute[73144]:       </nova:owner>
Aug 14 21:45:53 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:45:53 user nova-compute[73144]:       <nova:ports>
Aug 14 21:45:53 user nova-compute[73144]:         <nova:port uuid="b9bf4874-52b4-4f3f-8f07-debfa604caef">
Aug 14 21:45:53 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 21:45:53 user nova-compute[73144]:         </nova:port>
Aug 14 21:45:53 user nova-compute[73144]:       </nova:ports>
Aug 14 21:45:53 user nova-compute[73144]:     </nova:instance>
Aug 14 21:45:53 user nova-compute[73144]:   </metadata>
Aug 14 21:45:53 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:45:53 user nova-compute[73144]:     <system>
Aug 14 21:45:53 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:45:53 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:45:53 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:45:53 user nova-compute[73144]:       <entry name="serial">3c176f40-fc9b-4b76-8bbb-5aaebc494599</entry>
Aug 14 21:45:53 user nova-compute[73144]:       <entry name="uuid">3c176f40-fc9b-4b76-8bbb-5aaebc494599</entry>
Aug 14 21:45:53 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:45:53 user nova-compute[73144]:     </system>
Aug 14 21:45:53 user nova-compute[73144]:   </sysinfo>
Aug 14 21:45:53 user nova-compute[73144]:   <os>
Aug 14 21:45:53 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:45:53 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:45:53 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:45:53 user nova-compute[73144]:   </os>
Aug 14 21:45:53 user nova-compute[73144]:   <features>
Aug 14 21:45:53 user nova-compute[73144]:     <acpi/>
Aug 14 21:45:53 user nova-compute[73144]:     <apic/>
Aug 14 21:45:53 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:45:53 user nova-compute[73144]:   </features>
Aug 14 21:45:53 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:45:53 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:45:53 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:45:53 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:45:53 user nova-compute[73144]:   </clock>
Aug 14 21:45:53 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:45:53 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:45:53 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:45:53 user nova-compute[73144]:   </cpu>
Aug 14 21:45:53 user nova-compute[73144]:   <devices>
Aug 14 21:45:53 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:45:53 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:45:53 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk"/>
Aug 14 21:45:53 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:45:53 user nova-compute[73144]:     </disk>
Aug 14 21:45:53 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:45:53 user nova-compute[73144]:       <mac address="fa:16:3e:ac:67:18"/>
Aug 14 21:45:53 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:53 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:45:53 user nova-compute[73144]:       <target dev="tapb9bf4874-52"/>
Aug 14 21:45:53 user nova-compute[73144]:     </interface>
Aug 14 21:45:53 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:45:53 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/console.log" append="off"/>
Aug 14 21:45:53 user nova-compute[73144]:     </serial>
Aug 14 21:45:53 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:45:53 user nova-compute[73144]:     <video>
Aug 14 21:45:53 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:45:53 user nova-compute[73144]:     </video>
Aug 14 21:45:53 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:45:53 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:45:53 user nova-compute[73144]:     </rng>
Aug 14 21:45:53 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:45:53 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:45:53 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:45:53 user nova-compute[73144]:     </memballoon>
Aug 14 21:45:53 user nova-compute[73144]:   </devices>
Aug 14 21:45:53 user nova-compute[73144]: </domain>
Aug 14 21:45:53 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2012080635',display_name='tempest-VolumesActionsTest-instance-2012080635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2012080635',id=10,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb0c2aa06bc45b08fccb6f18c12c67f',ramdisk_id='',reservation_id='r-mehdw77w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1332231170',owner_user_name='tempest-VolumesActionsTest-1332231170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:45:50Z,user_data=None,user_id='df1eea89fe1a4c86b975e25b0396c1a0',uuid=3c176f40-fc9b-4b76-8bbb-5aaebc494599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Converting VIF {"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:67:18,bridge_name='br-int',has_traffic_filtering=True,id=b9bf4874-52b4-4f3f-8f07-debfa604caef,network=Network(92ea8945-5343-406f-8aa4-ad39548593e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bf4874-52') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG os_vif [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:67:18,bridge_name='br-int',has_traffic_filtering=True,id=b9bf4874-52b4-4f3f-8f07-debfa604caef,network=Network(92ea8945-5343-406f-8aa4-ad39548593e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bf4874-52') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9bf4874-52, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9bf4874-52, col_values=(('external_ids', {'iface-id': 'b9bf4874-52b4-4f3f-8f07-debfa604caef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:67:18', 'vm-uuid': '3c176f40-fc9b-4b76-8bbb-5aaebc494599'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:53 user nova-compute[73144]: INFO os_vif [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:67:18,bridge_name='br-int',has_traffic_filtering=True,id=b9bf4874-52b4-4f3f-8f07-debfa604caef,network=Network(92ea8945-5343-406f-8aa4-ad39548593e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bf4874-52')
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] No VIF found with MAC fa:16:3e:ac:67:18, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Updated VIF entry in instance network info cache for port b9bf4874-52b4-4f3f-8f07-debfa604caef. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Updating instance_info_cache with network_info: [{"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5bc2d764-60ba-4bc7-a10c-3af6951130b0 req-a3a06ff5-e634-4fe4-b2f3-6528ad0e1c47 service nova] Releasing lock "refresh_cache-3c176f40-fc9b-4b76-8bbb-5aaebc494599" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf84a22f-f711-4e45-bb07-cc786876a89c req-b06279cf-9ae6-4f6a-b6dd-9fc346022f29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf84a22f-f711-4e45-bb07-cc786876a89c req-b06279cf-9ae6-4f6a-b6dd-9fc346022f29 service nova] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf84a22f-f711-4e45-bb07-cc786876a89c req-b06279cf-9ae6-4f6a-b6dd-9fc346022f29 service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf84a22f-f711-4e45-bb07-cc786876a89c req-b06279cf-9ae6-4f6a-b6dd-9fc346022f29 service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf84a22f-f711-4e45-bb07-cc786876a89c req-b06279cf-9ae6-4f6a-b6dd-9fc346022f29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] No waiting events found dispatching network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:54 user nova-compute[73144]: WARNING nova.compute.manager [req-cf84a22f-f711-4e45-bb07-cc786876a89c req-b06279cf-9ae6-4f6a-b6dd-9fc346022f29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received unexpected event network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 for instance with vm_state active and task_state None.
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:45:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:45:57 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049557.670662, 3c176f40-fc9b-4b76-8bbb-5aaebc494599 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] VM Resumed (Lifecycle Event)
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:45:58 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:58 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7351MB free_disk=25.71914291381836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Instance spawned successfully.
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:45:58 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049557.671625, 3c176f40-fc9b-4b76-8bbb-5aaebc494599 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:45:58 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] VM Started (Lifecycle Event)
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:45:58 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:45:58 user nova-compute[73144]: INFO nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Took 8.13 seconds to spawn the instance on the hypervisor.
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:45:58 user nova-compute[73144]: INFO nova.compute.manager [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Took 9.51 seconds to build instance.
Aug 14 21:45:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5470c76c-f9cf-4e2a-bd0a-6b69549b671a tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.695s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e17e5d16-9301-4788-ae7d-495c36e6df58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ae3ee52c-0811-4c67-a43e-736e02c5511d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4583cc14-41a8-46b7-85d5-440efba5ec4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e522c4f9-2830-4f29-9c1c-17425af77440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 97bb9730-6643-4fa6-be15-05c6f920b2db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3c176f40-fc9b-4b76-8bbb-5aaebc494599 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:45:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.893s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-f3510805-bf0b-44d2-9e8f-5fd206f4f702 req-7f4925dc-8321-461d-8554-2657c8203b7f service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f3510805-bf0b-44d2-9e8f-5fd206f4f702 req-7f4925dc-8321-461d-8554-2657c8203b7f service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f3510805-bf0b-44d2-9e8f-5fd206f4f702 req-7f4925dc-8321-461d-8554-2657c8203b7f service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f3510805-bf0b-44d2-9e8f-5fd206f4f702 req-7f4925dc-8321-461d-8554-2657c8203b7f service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-f3510805-bf0b-44d2-9e8f-5fd206f4f702 req-7f4925dc-8321-461d-8554-2657c8203b7f service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:45:59 user nova-compute[73144]: WARNING nova.compute.manager [req-f3510805-bf0b-44d2-9e8f-5fd206f4f702 req-7f4925dc-8321-461d-8554-2657c8203b7f service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state active and task_state None.
Aug 14 21:45:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:45:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid e17e5d16-9301-4788-ae7d-495c36e6df58 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updating instance_info_cache with network_info: [{"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-e17e5d16-9301-4788-ae7d-495c36e6df58" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:46:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:46:01 user nova-compute[73144]: WARNING nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state active and task_state None.
Aug 14 21:46:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] No waiting events found dispatching network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:46:01 user nova-compute[73144]: WARNING nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received unexpected event network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae for instance with vm_state active and task_state None.
Aug 14 21:46:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] No waiting events found dispatching network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:46:01 user nova-compute[73144]: WARNING nova.compute.manager [req-505242af-4c66-451b-957a-2f7dd32c83e1 req-56f3e412-f628-417b-9125-b6562ad29a4e service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received unexpected event network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae for instance with vm_state active and task_state None.
Aug 14 21:46:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-caecfa65-71f2-4915-912a-7793b9dea28e req-aa7cd1b5-e961-45a5-9ff1-8af638cb2002 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-caecfa65-71f2-4915-912a-7793b9dea28e req-aa7cd1b5-e961-45a5-9ff1-8af638cb2002 service nova] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-caecfa65-71f2-4915-912a-7793b9dea28e req-aa7cd1b5-e961-45a5-9ff1-8af638cb2002 service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-caecfa65-71f2-4915-912a-7793b9dea28e req-aa7cd1b5-e961-45a5-9ff1-8af638cb2002 service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-caecfa65-71f2-4915-912a-7793b9dea28e req-aa7cd1b5-e961-45a5-9ff1-8af638cb2002 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] No waiting events found dispatching network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:46:06 user nova-compute[73144]: WARNING nova.compute.manager [req-caecfa65-71f2-4915-912a-7793b9dea28e req-aa7cd1b5-e961-45a5-9ff1-8af638cb2002 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received unexpected event network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf for instance with vm_state active and task_state None.
Aug 14 21:46:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] No waiting events found dispatching network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:46:08 user nova-compute[73144]: WARNING nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received unexpected event network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf for instance with vm_state active and task_state None.
Aug 14 21:46:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received event network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Acquiring lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] No waiting events found dispatching network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:46:08 user nova-compute[73144]: WARNING nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received unexpected event network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef for instance with vm_state active and task_state None.
Aug 14 21:46:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received event network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Acquiring lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] No waiting events found dispatching network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:46:08 user nova-compute[73144]: WARNING nova.compute.manager [req-55cff013-0c49-416e-9725-712b185bfdd4 req-4814f60a-943d-456a-92f3-b65ef9c359c3 service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received unexpected event network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef for instance with vm_state active and task_state None.
Aug 14 21:46:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:46:21 user nova-compute[73144]: INFO nova.compute.claims [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Claim successful on node user
Aug 14 21:46:21 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:46:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:46:21 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:46:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:46:22 user nova-compute[73144]: INFO nova.virt.block_device [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Booting with volume b2e2404e-60ab-4662-88e0-90c2d2794abe at /dev/vda
Aug 14 21:46:22 user nova-compute[73144]: DEBUG nova.policy [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3c618c44614454cbcc49fd12f4024b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6708546a68844379bb72703ef7489d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:46:22 user nova-compute[73144]: DEBUG os_brick.utils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:46:22 user nova-compute[73144]: INFO oslo.privsep.daemon [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpj4psrigb/privsep.sock']
Aug 14 21:46:22 user sudo[84553]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpj4psrigb/privsep.sock
Aug 14 21:46:22 user sudo[84553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 21:46:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully created port: 0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:46:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully created port: 7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:46:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully created port: f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:46:24 user sudo[84553]: pam_unix(sudo:session): session closed for user root
Aug 14 21:46:24 user nova-compute[73144]: INFO oslo.privsep.daemon [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Spawned new privsep daemon via rootwrap
Aug 14 21:46:24 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 21:46:24 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 21:46:24 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 21:46:24 user nova-compute[73144]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84572
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b1792-107b-4e4a-8c32-d919d933913e]: (2,) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a55a38a-cabf-44ca-b8b5-c90547cdf1ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:24 user nova-compute[73144]: WARNING os_brick.initiator.connectors.nvmeof [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1d1297-bde3-4a07-8587-b43042250f08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dd1881-dc22-4a5f-b8ee-ae3589441e22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb87d86-df54-44f1-adf4-1017fadc2346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:24 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:46:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[47933567-1866-4210-98d8-6baac0aaf000]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG os_brick.utils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== get_connector_properties: return (2185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating existing volume attachment record: 0b5a6992-cb4e-45a9-b1c3-cbd3109af96a {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:46:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully created port: 6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:46:25 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully created port: ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:46:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:25 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully updated port: 0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port 0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-22ebd6d4-a8d5-4f8b-a3d2-57fd7836a971 req-37647d2a-1d43-4b2a-aa70-9774a650a3d6 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully updated port: dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:46:27 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully updated port: 010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port 010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully updated port: 7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a61594b8-61b1-48af-94fb-d5960ae93418 req-b20377ae-aa7d-45ab-9019-f471edba09e9 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully updated port: f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully updated port: 6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.compute.manager [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.compute.manager [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-7c34f297-7cee-4930-913e-d23e4e0ce730. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port 7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.compute.manager [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.compute.manager [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-f0bdae5c-0379-40e5-825d-3f427e72500f. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-282f1f02-07d4-4b0d-8d86-25788fa6a50c req-c64b9664-9ae1-462a-8415-254667213333 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Successfully updated port: ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:46:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:46:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:46:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:32 user nova-compute[73144]: INFO nova.virt.block_device [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Booting with volume bbcd2919-73a1-44b5-8d44-7c4435a1392c at /dev/vdb
Aug 14 21:46:33 user nova-compute[73144]: DEBUG os_brick.utils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7163bc-475b-4e93-896d-87de7aa0c06f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77640b-45ac-40fd-9865-0bd9080cae20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4862f91-68ca-465b-ad1c-62188cd316e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[309334da-7b35-4cc7-bccc-c9efca8bab4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:33 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ca21a-b4db-49d9-856a-179900355575]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG os_brick.utils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating existing volume attachment record: 58632af0-af9f-45be-9f0f-d1649963138e {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [{"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance network_info: |[{"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.network.neutron [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port 6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.network.neutron [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updated VIF entry in instance network info cache for port 6d244fe2-f52b-40fb-8ccf-cf2b7956f08b. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.network.neutron [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [{"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-ee36fb49-f455-497d-b96e-e1a1d4d464d9. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:46:33 user nova-compute[73144]: DEBUG nova.network.neutron [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:46:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updated VIF entry in instance network info cache for port ee36fb49-f455-497d-b96e-e1a1d4d464d9. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:46:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [{"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:46:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7c448f7-1590-43d8-8c3b-d3f223542089 req-455c52f5-2861-43ef-a1aa-cf6e501880e4 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:46:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:41 user nova-compute[73144]: INFO nova.virt.block_device [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Booting with volume b67e0522-d784-4cbc-9a8c-465480082448 at /dev/vdc
Aug 14 21:46:41 user nova-compute[73144]: DEBUG os_brick.utils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:46:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2279f882-a7ec-4563-ade9-a976319d4b76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024e5a1-6640-4c63-949b-1117a59b180f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d1e1a-80b1-4dd0-a7af-5fa5a1459e62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384daf0-37e1-4dd4-86b6-e76f20b4b507]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:42 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:46:42 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff217231-4261-4771-80d0-8f4e41aff340]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG os_brick.utils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:46:42 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating existing volume attachment record: aee311bc-d2c7-4ade-a7c3-a144c84d475d {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:46:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:46:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:46:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:46:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:50 user nova-compute[73144]: DEBUG nova.objects.instance [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lazy-loading 'flavor' on Instance uuid e17e5d16-9301-4788-ae7d-495c36e6df58 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:46:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:51 user nova-compute[73144]: INFO nova.compute.manager [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Attaching volume 9e4b1956-15bb-4b08-9e79-9195a1b30fb7 to /dev/vdb
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.utils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a663e-00ae-42e5-805a-ba1a36ac3ac4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c260f6-fb8d-437f-ab63-69ee7c4bd0c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1afaff9-e943-4a7c-a066-e40a0c0c047d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e42a83-857d-4e71-8222-36298e23a0b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:46:51 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fdaa84-3d8d-47e5-a19a-c46d35591687]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.utils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updating existing volume attachment record: 9e17ce30-386c-4fb1-8b06-cd93fcec3fde {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:46:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Creating image(s)
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Ensure instance console log exists: /opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Start _get_guest_xml network_info=[{"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '0b5a6992-cb4e-45a9-b1c3-cbd3109af96a', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PErdMvCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94b0537b-818e-4ce5-9175-b3d9014b6afa', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2e2404e-60ab-4662-88e0-90c2d2794abe', 'serial': 'b2e2404e-60ab-4662-88e0-90c2d2794abe'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'disk_bus': 'virtio', 'attachment_id': '58632af0-af9f-45be-9f0f-d1649963138e', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klTFyQhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94b0537b-818e-4ce5-9175-b3d9014b6afa', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbcd2919-73a1-44b5-8d44-7c4435a1392c', 'serial': 'bbcd2919-73a1-44b5-8d44-7c4435a1392c'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'disk_bus': 'virtio', 'attachment_id': 'aee311bc-d2c7-4ade-a7c3-a144c84d475d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SngYfIjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94b0537b-818e-4ce5-9175-b3d9014b6afa', 'attached_at': '', 'detached_at': '', 'volume_id': 'b67e0522-d784-4cbc-9a8c-465480082448', 'serial': 'b67e0522-d784-4cbc-9a8c-465480082448'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:46:51 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:46:51 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connector [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Factory for ISCSI on None {{(pid=73144) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.011s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PErdMvCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:46:51 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:46:51 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:46:51 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a87b08c-5cc1-4e65-b61b-ddf73df5a0de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:46:51 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c449f68b-08d5-451b-8288-3a9079873710]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe] added
Aug 14 21:46:51 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2626045-20f1-4eec-893e-c58ca482ad5f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b81e6f-dced-4078-87eb-6c4ffd62319b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PErdMvCY {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PErdMvCY" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc785c-cd8d-4f51-90b9-aaba20bc9b41]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PErdMvCY'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c335dc-e4c4-4016-a2a1-66acbe60d83e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[886dea92-b8cf-4bca-a81f-64e1f85bafa3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:46:51 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:46:51 user nova-compute[73144]:  {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:46:51 user nova-compute[73144]: WARNING os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 21:46:51 user nova-compute[73144]: 
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5650d00-c857-4c43-97e2-36a5d0e697dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260]
Aug 14 21:46:51 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260] successful.
Aug 14 21:46:51 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db5f71-f585-44e0-bdd1-7bfaee72485d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43554a8-9cb9-4a62-a024-26f8bdf13422]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:51 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:51 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b384b52-d23f-480c-ad9b-aa1abc047aad]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:51 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PErdMvCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26638613064623261', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638613064623261', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klTFyQhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:46:52 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:46:52 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:46:52 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469d943-0b72-4399-bf36-bbe0ddd8b8d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:46:52 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[761e43b8-923e-4086-aa89-08e9fa84f8a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c] added
Aug 14 21:46:52 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea0f942-3f30-407e-83b9-942fb495f2d2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3032ef-1c42-4951-9d46-057cd5fef292]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klTFyQhM {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klTFyQhM" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b1ceef-0f46-4e07-899e-ad3c99228b2f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'klTFyQhM'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.106s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e2c7a-6a8d-4ffc-b439-e91b84028f5c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[446eaa6c-b954-44ed-9ff3-2a9a0d0d9581]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:53 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:53 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4417c88f-c39d-4473-945a-9cbea70cc2f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260]
Aug 14 21:46:53 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260] successful.
Aug 14 21:46:53 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[91545c4d-af7f-4136-b783-d9d75e90d2c3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a5eb18-c81d-400f-b48e-f9fa1b0a035f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:53 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:46:53 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:53 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:46:53 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[402c7e64-b64c-4535-b876-3f5b900b7a43]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klTFyQhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26631646466336262', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631646466336262', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SngYfIjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:46:54 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:46:54 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:46:54 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd61aa1-25c4-48fb-8ea0-94d0819806b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:46:54 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f8f7b-36ba-49e3-a4e0-f85d07b25d53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448] added
Aug 14 21:46:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea777048-fdb2-4b8b-a6b2-b1b5895c3986]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6989bbfc-82a7-455f-abf4-608c10419c56]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SngYfIjU {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SngYfIjU" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31e28f7-d2d9-427f-b865-10ae472a8084]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SngYfIjU'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1252aa53-702c-48f8-b800-8ea2bff56c70]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca8cdf4-3409-4fe6-9a0d-5605145751fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:46:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:46:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ffeba0-4b98-4e9b-8e8d-7ec745279bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260]
Aug 14 21:46:54 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260] successful.
Aug 14 21:46:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f0dc3-4389-44d0-89cc-844fd86e2d62]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dfc9ca-8cea-4cfa-b508-9bedee1fda04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:46:54 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:46:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:46:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:46:54 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:46:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2659e-6c2e-4230-b507-1b03fed82d65]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SngYfIjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26130333536333361', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130333536333361', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:2c:ee,bridge_name='br-int',has_traffic_filtering=True,id=0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea,network=Network(62826183-eb6e-42e2-808e-9387f475c27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df2c88f-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=dfc8d9a0-97bf-4a69-bdf3-0072178b15a5,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc8d9a0-97') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f9:1a,bridge_name='br-int',has_traffic_filtering=True,id=010e5966-6fd5-4fa8-bb29-1a4aaa80c8af,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap010e5966-6f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=7c34f297-7cee-4930-913e-d23e4e0ce730,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c34f297-7c') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=f0bdae5c-0379-40e5-825d-3f427e72500f,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdae5c-03') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=6d244fe2-f52b-40fb-8ccf-cf2b7956f08b,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244fe2-f5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:60:39,bridge_name='br-int',has_traffic_filtering=True,id=ee36fb49-f455-497d-b96e-e1a1d4d464d9,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee36fb49-f4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.objects.instance [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lazy-loading 'pci_devices' on Instance uuid 94b0537b-818e-4ce5-9175-b3d9014b6afa {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:46:55 user nova-compute[73144]:   <uuid>94b0537b-818e-4ce5-9175-b3d9014b6afa</uuid>
Aug 14 21:46:55 user nova-compute[73144]:   <name>instance-0000000b</name>
Aug 14 21:46:55 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:46:55 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:46:55 user nova-compute[73144]:   <metadata>
Aug 14 21:46:55 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:46:55 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:46:55 user nova-compute[73144]:       <nova:name>tempest-device-tagging-server-526590275</nova:name>
Aug 14 21:46:55 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:46:51</nova:creationTime>
Aug 14 21:46:55 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:46:55 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:46:55 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:46:55 user nova-compute[73144]:       <nova:owner>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:user uuid="c3c618c44614454cbcc49fd12f4024b1">tempest-TaggedBootDevicesTest-1166239274-project-member</nova:user>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:project uuid="d6708546a68844379bb72703ef7489d1">tempest-TaggedBootDevicesTest-1166239274</nova:project>
Aug 14 21:46:55 user nova-compute[73144]:       </nova:owner>
Aug 14 21:46:55 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:46:55 user nova-compute[73144]:       <nova:ports>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:port uuid="0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea">
Aug 14 21:46:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 21:46:55 user nova-compute[73144]:         </nova:port>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:port uuid="dfc8d9a0-97bf-4a69-bdf3-0072178b15a5">
Aug 14 21:46:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Aug 14 21:46:55 user nova-compute[73144]:         </nova:port>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:port uuid="010e5966-6fd5-4fa8-bb29-1a4aaa80c8af">
Aug 14 21:46:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Aug 14 21:46:55 user nova-compute[73144]:         </nova:port>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:port uuid="7c34f297-7cee-4930-913e-d23e4e0ce730">
Aug 14 21:46:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Aug 14 21:46:55 user nova-compute[73144]:         </nova:port>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:port uuid="f0bdae5c-0379-40e5-825d-3f427e72500f">
Aug 14 21:46:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.199" ipVersion="4"/>
Aug 14 21:46:55 user nova-compute[73144]:         </nova:port>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:port uuid="6d244fe2-f52b-40fb-8ccf-cf2b7956f08b">
Aug 14 21:46:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 21:46:55 user nova-compute[73144]:         </nova:port>
Aug 14 21:46:55 user nova-compute[73144]:         <nova:port uuid="ee36fb49-f455-497d-b96e-e1a1d4d464d9">
Aug 14 21:46:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 21:46:55 user nova-compute[73144]:         </nova:port>
Aug 14 21:46:55 user nova-compute[73144]:       </nova:ports>
Aug 14 21:46:55 user nova-compute[73144]:     </nova:instance>
Aug 14 21:46:55 user nova-compute[73144]:   </metadata>
Aug 14 21:46:55 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:46:55 user nova-compute[73144]:     <system>
Aug 14 21:46:55 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:46:55 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:46:55 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:46:55 user nova-compute[73144]:       <entry name="serial">94b0537b-818e-4ce5-9175-b3d9014b6afa</entry>
Aug 14 21:46:55 user nova-compute[73144]:       <entry name="uuid">94b0537b-818e-4ce5-9175-b3d9014b6afa</entry>
Aug 14 21:46:55 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:46:55 user nova-compute[73144]:     </system>
Aug 14 21:46:55 user nova-compute[73144]:   </sysinfo>
Aug 14 21:46:55 user nova-compute[73144]:   <os>
Aug 14 21:46:55 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:46:55 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:46:55 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:46:55 user nova-compute[73144]:   </os>
Aug 14 21:46:55 user nova-compute[73144]:   <features>
Aug 14 21:46:55 user nova-compute[73144]:     <acpi/>
Aug 14 21:46:55 user nova-compute[73144]:     <apic/>
Aug 14 21:46:55 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:46:55 user nova-compute[73144]:   </features>
Aug 14 21:46:55 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:46:55 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:46:55 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:46:55 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:46:55 user nova-compute[73144]:   </clock>
Aug 14 21:46:55 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:46:55 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:46:55 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:46:55 user nova-compute[73144]:   </cpu>
Aug 14 21:46:55 user nova-compute[73144]:   <devices>
Aug 14 21:46:55 user nova-compute[73144]:     <disk type="file" device="cdrom">
Aug 14 21:46:55 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 21:46:55 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa/disk.config"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="hda" bus="ide"/>
Aug 14 21:46:55 user nova-compute[73144]:     </disk>
Aug 14 21:46:55 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:46:55 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:46:55 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <serial>b2e2404e-60ab-4662-88e0-90c2d2794abe</serial>
Aug 14 21:46:55 user nova-compute[73144]:     </disk>
Aug 14 21:46:55 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:46:55 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:46:55 user nova-compute[73144]:       <source dev="/dev/sdc"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <serial>bbcd2919-73a1-44b5-8d44-7c4435a1392c</serial>
Aug 14 21:46:55 user nova-compute[73144]:     </disk>
Aug 14 21:46:55 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:46:55 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:46:55 user nova-compute[73144]:       <source dev="/dev/sdd"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="vdc" bus="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <serial>b67e0522-d784-4cbc-9a8c-465480082448</serial>
Aug 14 21:46:55 user nova-compute[73144]:     </disk>
Aug 14 21:46:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:46:55 user nova-compute[73144]:       <mac address="fa:16:3e:75:2c:ee"/>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="tap0df2c88f-1d"/>
Aug 14 21:46:55 user nova-compute[73144]:     </interface>
Aug 14 21:46:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:46:55 user nova-compute[73144]:       <mac address="fa:16:3e:5c:f9:81"/>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="tapdfc8d9a0-97"/>
Aug 14 21:46:55 user nova-compute[73144]:     </interface>
Aug 14 21:46:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:46:55 user nova-compute[73144]:       <mac address="fa:16:3e:56:f9:1a"/>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="tap010e5966-6f"/>
Aug 14 21:46:55 user nova-compute[73144]:     </interface>
Aug 14 21:46:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:46:55 user nova-compute[73144]:       <mac address="fa:16:3e:2e:13:ba"/>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="tap7c34f297-7c"/>
Aug 14 21:46:55 user nova-compute[73144]:     </interface>
Aug 14 21:46:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:46:55 user nova-compute[73144]:       <mac address="fa:16:3e:8e:e7:00"/>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="tapf0bdae5c-03"/>
Aug 14 21:46:55 user nova-compute[73144]:     </interface>
Aug 14 21:46:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:46:55 user nova-compute[73144]:       <mac address="fa:16:3e:57:e6:37"/>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="tap6d244fe2-f5"/>
Aug 14 21:46:55 user nova-compute[73144]:     </interface>
Aug 14 21:46:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:46:55 user nova-compute[73144]:       <mac address="fa:16:3e:76:60:39"/>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:46:55 user nova-compute[73144]:       <target dev="tapee36fb49-f4"/>
Aug 14 21:46:55 user nova-compute[73144]:     </interface>
Aug 14 21:46:55 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:46:55 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa/console.log" append="off"/>
Aug 14 21:46:55 user nova-compute[73144]:     </serial>
Aug 14 21:46:55 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:46:55 user nova-compute[73144]:     <video>
Aug 14 21:46:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:46:55 user nova-compute[73144]:     </video>
Aug 14 21:46:55 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:46:55 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:46:55 user nova-compute[73144]:     </rng>
Aug 14 21:46:55 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:46:55 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:46:55 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:46:55 user nova-compute[73144]:     </memballoon>
Aug 14 21:46:55 user nova-compute[73144]:   </devices>
Aug 14 21:46:55 user nova-compute[73144]: </domain>
Aug 14 21:46:55 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:2c:ee,bridge_name='br-int',has_traffic_filtering=True,id=0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea,network=Network(62826183-eb6e-42e2-808e-9387f475c27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df2c88f-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:2c:ee,bridge_name='br-int',has_traffic_filtering=True,id=0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea,network=Network(62826183-eb6e-42e2-808e-9387f475c27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df2c88f-1d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0df2c88f-1d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0df2c88f-1d, col_values=(('external_ids', {'iface-id': '0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:2c:ee', 'vm-uuid': '94b0537b-818e-4ce5-9175-b3d9014b6afa'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: INFO os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:2c:ee,bridge_name='br-int',has_traffic_filtering=True,id=0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea,network=Network(62826183-eb6e-42e2-808e-9387f475c27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df2c88f-1d')
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=dfc8d9a0-97bf-4a69-bdf3-0072178b15a5,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc8d9a0-97') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=dfc8d9a0-97bf-4a69-bdf3-0072178b15a5,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc8d9a0-97') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc8d9a0-97, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfc8d9a0-97, col_values=(('external_ids', {'iface-id': 'dfc8d9a0-97bf-4a69-bdf3-0072178b15a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:f9:81', 'vm-uuid': '94b0537b-818e-4ce5-9175-b3d9014b6afa'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: INFO os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=dfc8d9a0-97bf-4a69-bdf3-0072178b15a5,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc8d9a0-97')
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f9:1a,bridge_name='br-int',has_traffic_filtering=True,id=010e5966-6fd5-4fa8-bb29-1a4aaa80c8af,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap010e5966-6f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f9:1a,bridge_name='br-int',has_traffic_filtering=True,id=010e5966-6fd5-4fa8-bb29-1a4aaa80c8af,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap010e5966-6f') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap010e5966-6f, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap010e5966-6f, col_values=(('external_ids', {'iface-id': '010e5966-6fd5-4fa8-bb29-1a4aaa80c8af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:f9:1a', 'vm-uuid': '94b0537b-818e-4ce5-9175-b3d9014b6afa'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: INFO os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f9:1a,bridge_name='br-int',has_traffic_filtering=True,id=010e5966-6fd5-4fa8-bb29-1a4aaa80c8af,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap010e5966-6f')
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=7c34f297-7cee-4930-913e-d23e4e0ce730,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c34f297-7c') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=7c34f297-7cee-4930-913e-d23e4e0ce730,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c34f297-7c') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c34f297-7c, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c34f297-7c, col_values=(('external_ids', {'iface-id': '7c34f297-7cee-4930-913e-d23e4e0ce730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:13:ba', 'vm-uuid': '94b0537b-818e-4ce5-9175-b3d9014b6afa'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: INFO os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=7c34f297-7cee-4930-913e-d23e4e0ce730,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c34f297-7c')
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=f0bdae5c-0379-40e5-825d-3f427e72500f,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdae5c-03') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=f0bdae5c-0379-40e5-825d-3f427e72500f,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdae5c-03') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0bdae5c-03, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0bdae5c-03, col_values=(('external_ids', {'iface-id': 'f0bdae5c-0379-40e5-825d-3f427e72500f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:e7:00', 'vm-uuid': '94b0537b-818e-4ce5-9175-b3d9014b6afa'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: INFO os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=f0bdae5c-0379-40e5-825d-3f427e72500f,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdae5c-03')
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=6d244fe2-f52b-40fb-8ccf-cf2b7956f08b,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244fe2-f5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=6d244fe2-f52b-40fb-8ccf-cf2b7956f08b,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244fe2-f5') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d244fe2-f5, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d244fe2-f5, col_values=(('external_ids', {'iface-id': '6d244fe2-f52b-40fb-8ccf-cf2b7956f08b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:e6:37', 'vm-uuid': '94b0537b-818e-4ce5-9175-b3d9014b6afa'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: INFO os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=6d244fe2-f52b-40fb-8ccf-cf2b7956f08b,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244fe2-f5')
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:60:39,bridge_name='br-int',has_traffic_filtering=True,id=ee36fb49-f455-497d-b96e-e1a1d4d464d9,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee36fb49-f4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:60:39,bridge_name='br-int',has_traffic_filtering=True,id=ee36fb49-f455-497d-b96e-e1a1d4d464d9,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee36fb49-f4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee36fb49-f4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee36fb49-f4, col_values=(('external_ids', {'iface-id': 'ee36fb49-f455-497d-b96e-e1a1d4d464d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:60:39', 'vm-uuid': '94b0537b-818e-4ce5-9175-b3d9014b6afa'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:46:56 user nova-compute[73144]: INFO os_vif [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:60:39,bridge_name='br-int',has_traffic_filtering=True,id=ee36fb49-f455-497d-b96e-e1a1d4d464d9,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee36fb49-f4')
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] No BDM found with device name hda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] No VIF found with MAC fa:16:3e:75:2c:ee, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] No VIF found with MAC fa:16:3e:8e:e7:00, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:46:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Using config drive
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Creating config drive at /opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa/disk.config
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4ymrkv7 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:46:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4ymrkv7" returned: 0 in 0.123s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-changed-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Refreshing instance network info cache due to event network-changed-5a900812-f1ea-4f9e-bff4-84e9e72f5f42. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] Acquiring lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] Acquired lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Refreshing network info cache for port 5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-4707424e-acc3-4726-a293-f5d8211c8df2 req-6dcafb25-6c0c-4ff8-a8f8-1f1bd9e8aabf service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4707424e-acc3-4726-a293-f5d8211c8df2 req-6dcafb25-6c0c-4ff8-a8f8-1f1bd9e8aabf service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4707424e-acc3-4726-a293-f5d8211c8df2 req-6dcafb25-6c0c-4ff8-a8f8-1f1bd9e8aabf service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4707424e-acc3-4726-a293-f5d8211c8df2 req-6dcafb25-6c0c-4ff8-a8f8-1f1bd9e8aabf service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-4707424e-acc3-4726-a293-f5d8211c8df2 req-6dcafb25-6c0c-4ff8-a8f8-1f1bd9e8aabf service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.compute.manager [req-4707424e-acc3-4726-a293-f5d8211c8df2 req-6dcafb25-6c0c-4ff8-a8f8-1f1bd9e8aabf service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea for instance with vm_state building and task_state spawning.
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-6604e5c2-d59b-4b3a-a809-e0f3277dcfed req-842752f3-ab0f-417c-be51-debbfaf81900 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6604e5c2-d59b-4b3a-a809-e0f3277dcfed req-842752f3-ab0f-417c-be51-debbfaf81900 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6604e5c2-d59b-4b3a-a809-e0f3277dcfed req-842752f3-ab0f-417c-be51-debbfaf81900 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6604e5c2-d59b-4b3a-a809-e0f3277dcfed req-842752f3-ab0f-417c-be51-debbfaf81900 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-6604e5c2-d59b-4b3a-a809-e0f3277dcfed req-842752f3-ab0f-417c-be51-debbfaf81900 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.compute.manager [req-6604e5c2-d59b-4b3a-a809-e0f3277dcfed req-842752f3-ab0f-417c-be51-debbfaf81900 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af for instance with vm_state building and task_state spawning.
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-760e6b59-ad9a-49c7-8474-aedb33d7c97d req-fb17c253-109c-4562-80c8-1409dd69a7c4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-760e6b59-ad9a-49c7-8474-aedb33d7c97d req-fb17c253-109c-4562-80c8-1409dd69a7c4 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-760e6b59-ad9a-49c7-8474-aedb33d7c97d req-fb17c253-109c-4562-80c8-1409dd69a7c4 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-760e6b59-ad9a-49c7-8474-aedb33d7c97d req-fb17c253-109c-4562-80c8-1409dd69a7c4 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-760e6b59-ad9a-49c7-8474-aedb33d7c97d req-fb17c253-109c-4562-80c8-1409dd69a7c4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.compute.manager [req-760e6b59-ad9a-49c7-8474-aedb33d7c97d req-fb17c253-109c-4562-80c8-1409dd69a7c4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 for instance with vm_state building and task_state spawning.
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing instance network info cache due to event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.compute.manager [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af for instance with vm_state building and task_state spawning.
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.compute.manager [req-72069a42-f553-4cd1-bc0a-b6c6a616b61d req-fad53502-2eae-4823-ae27-4fdc201646a5 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f for instance with vm_state building and task_state spawning.
Aug 14 21:47:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMfkDCNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:02 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=6846MB free_disk=25.616928100585938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4f1279-8663-46aa-bfaa-486ca3d2f0e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:47:02 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f526745-c739-4f91-91a8-681018193878]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7] added
Aug 14 21:47:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a66df-08ba-4f6c-aaf4-27c403ac482c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73a409-0c54-4480-8e91-bde5bf130456]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMfkDCNg {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMfkDCNg" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2cc87-14f1-4ae3-b94a-0d92255dda01]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMfkDCNg'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fcfc93-3516-46bb-ad98-1c97b827065c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e17e5d16-9301-4788-ae7d-495c36e6df58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ae3ee52c-0811-4c67-a43e-736e02c5511d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4583cc14-41a8-46b7-85d5-440efba5ec4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e522c4f9-2830-4f29-9c1c-17425af77440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 97bb9730-6643-4fa6-be15-05c6f920b2db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3c176f40-fc9b-4b76-8bbb-5aaebc494599 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 94b0537b-818e-4ce5-9175-b3d9014b6afa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:47:02 user nova-compute[73144]: INFO nova.compute.manager [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] instance snapshotting
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae1c7d-a5b2-4f5c-8f38-5cfab406f10c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-changed-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Refreshing instance network info cache due to event network-changed-758cbe79-b4b9-40b7-93a4-37b07664efb4. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Refreshing network info cache for port 758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f85c42-e53d-4e19-a745-ccf352299eab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260]
Aug 14 21:47:02 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Beginning live snapshot process
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3711ec-7adb-4e5a-b05b-32194a9ee4e2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a86f1eb-7489-424c-aa65-089ae06bd645]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 (non-flash)
Aug 14 21:47:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:02 user nova-compute[73144]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 (non-flash)
Aug 14 21:47:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049622.9451199, 94b0537b-818e-4ce5-9175-b3d9014b6afa => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:02 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] VM Resumed (Lifecycle Event)
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.038s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29808c-ca9c-4cdf-b6ca-ee44221f4448]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMfkDCNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:47:02 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance spawned successfully.
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-b99ee29b-8d97-44fc-9848-80e6c036f4a6 req-6136ac36-202e-4da4-afb5-9806a8be8afc service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b99ee29b-8d97-44fc-9848-80e6c036f4a6 req-6136ac36-202e-4da4-afb5-9806a8be8afc service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b99ee29b-8d97-44fc-9848-80e6c036f4a6 req-6136ac36-202e-4da4-afb5-9806a8be8afc service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b99ee29b-8d97-44fc-9848-80e6c036f4a6 req-6136ac36-202e-4da4-afb5-9806a8be8afc service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-b99ee29b-8d97-44fc-9848-80e6c036f4a6 req-6136ac36-202e-4da4-afb5-9806a8be8afc service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:02 user nova-compute[73144]: WARNING nova.compute.manager [req-b99ee29b-8d97-44fc-9848-80e6c036f4a6 req-6136ac36-202e-4da4-afb5-9806a8be8afc service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:47:03 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049622.9452767, 94b0537b-818e-4ce5-9175-b3d9014b6afa => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:03 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] VM Started (Lifecycle Event)
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:03 user nova-compute[73144]: INFO nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Took 11.65 seconds to spawn the instance on the hypervisor.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updated VIF entry in instance network info cache for port 5a900812-f1ea-4f9e-bff4-84e9e72f5f42. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updating instance_info_cache with network_info: [{"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:03 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-changed-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Refreshing instance network info cache due to event network-changed-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] Acquiring lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] Acquired lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Refreshing network info cache for port 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94d8883f-7a31-4068-a5a2-17af3ab631b9 req-f188d6e8-9495-4e15-9f8e-0d1c98eeed29 service nova] Releasing lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:03 user nova-compute[73144]: INFO nova.compute.manager [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Took 42.16 seconds to build instance.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74546db4-107d-403f-a2de-794d6824f5b3 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.310s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.011s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updated VIF entry in instance network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updated VIF entry in instance network info cache for port 758cbe79-b4b9-40b7-93a4-37b07664efb4. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-changed-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Refreshing instance network info cache due to event network-changed-405993c1-92ac-4e9f-b75c-44deb4a9f3dd. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Acquiring lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Acquired lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Refreshing network info cache for port 405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:03 user nova-compute[73144]: WARNING nova.compute.manager [req-fddebd65-9444-464e-a830-4af185143412 req-a27ca75c-9b49-4d18-8665-60868689282d service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 for instance with vm_state building and task_state spawning.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8c3ry6lk/1f49ebcfb00242a7848094e23efc9cab.delta 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8c3ry6lk/1f49ebcfb00242a7848094e23efc9cab.delta 1073741824" returned: 0 in 0.053s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73144) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 21:47:03 user nova-compute[73144]: INFO nova.virt.libvirt.host [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] UEFI support detected
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updated VIF entry in instance network info cache for port 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23234616436616561', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234616436616561', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bf0d17db-2dd2-4c6a-8436-b932567695ff req-3327c4db-2cb5-4ac2-ac4c-0ea0cd4414d0 service nova] Releasing lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:03 user nova-compute[73144]: DEBUG nova.objects.instance [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lazy-loading 'flavor' on Instance uuid e17e5d16-9301-4788-ae7d-495c36e6df58 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:47:04 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:04 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:47:04 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:04 user nova-compute[73144]:   <serial>9e4b1956-15bb-4b08-9e79-9195a1b30fb7</serial>
Aug 14 21:47:04 user nova-compute[73144]: </disk>
Aug 14 21:47:04 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG nova.network.neutron [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updated VIF entry in instance network info cache for port 405993c1-92ac-4e9f-b75c-44deb4a9f3dd. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG nova.network.neutron [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fcadcc37-7342-4156-83f5-99b8969583b4 req-65153071-85a3-41ae-8083-f211d815e3bd service nova] Releasing lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid c16f9e34-3fc2-49c7-b0b8-99c5e5153818 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] COPY block job progress, current cursor: 2424832 final cursor: 75497472 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:04 user nova-compute[73144]: INFO nova.compute.manager [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Attaching volume bbc40de8-a398-4f35-bff3-8a4c80626d21 to /dev/vdb
Aug 14 21:47:04 user nova-compute[73144]: DEBUG os_brick.utils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[264f88cc-4de3-4968-9ec6-b79ab73ae63a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6299c85-c7a6-4ebf-a226-d33447cdb08e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d94fc6-352e-4cb9-a1e6-75511acfa449]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa043f95-cbdc-4bfe-b1e2-2b76bb688078]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:47:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] No VIF found with MAC fa:16:3e:fe:34:e9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:05 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[784950a2-6eb3-4a7e-a48f-6cc9ffbc2678]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG os_brick.utils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updating existing volume attachment record: df84c7f7-a272-4f83-bd1d-6ee82a4a11fc {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:05 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3dc406c8-e43a-48a1-b15c-e505aa465311 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.143s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8c3ry6lk/1f49ebcfb00242a7848094e23efc9cab.delta /opt/stack/data/nova/instances/snapshots/tmp8c3ry6lk/1f49ebcfb00242a7848094e23efc9cab {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updating instance_info_cache with network_info: [{"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-c16f9e34-3fc2-49c7-b0b8-99c5e5153818" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8c3ry6lk/1f49ebcfb00242a7848094e23efc9cab.delta /opt/stack/data/nova/instances/snapshots/tmp8c3ry6lk/1f49ebcfb00242a7848094e23efc9cab" returned: 0 in 0.315s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:05 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Snapshot extracted, beginning image upload
Aug 14 21:47:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:06 user nova-compute[73144]: INFO nova.compute.manager [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Terminating instance
Aug 14 21:47:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-ab64bb94-bb96-40bc-95e4-d641c00c6b90 req-35a258ee-4a8d-4403-b0c0-9bb18e5320fa service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received event network-vif-unplugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ab64bb94-bb96-40bc-95e4-d641c00c6b90 req-35a258ee-4a8d-4403-b0c0-9bb18e5320fa service nova] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ab64bb94-bb96-40bc-95e4-d641c00c6b90 req-35a258ee-4a8d-4403-b0c0-9bb18e5320fa service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ab64bb94-bb96-40bc-95e4-d641c00c6b90 req-35a258ee-4a8d-4403-b0c0-9bb18e5320fa service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-ab64bb94-bb96-40bc-95e4-d641c00c6b90 req-35a258ee-4a8d-4403-b0c0-9bb18e5320fa service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] No waiting events found dispatching network-vif-unplugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-ab64bb94-bb96-40bc-95e4-d641c00c6b90 req-35a258ee-4a8d-4403-b0c0-9bb18e5320fa service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received event network-vif-unplugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Instance destroyed successfully.
Aug 14 21:47:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lazy-loading 'resources' on Instance uuid e17e5d16-9301-4788-ae7d-495c36e6df58 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1272237829',display_name='tempest-DeleteServersTestJSON-server-1272237829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1272237829',id=1,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e0a65555fb74c488d074154dd2d5211',ramdisk_id='',reservation_id='r-nzy8kffr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-253902441',owner_user_name='tempest-DeleteServersTestJSON-253902441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:45:12Z,user_data=None,user_id='357a1593e398410d8165908904fdc642',uuid=e17e5d16-9301-4788-ae7d-495c36e6df58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Converting VIF {"id": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "address": "fa:16:3e:fe:34:e9", "network": {"id": "75f03656-3a5d-426c-bf1d-3b2fb46ff4ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-109890562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a65555fb74c488d074154dd2d5211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc20fc88-25", "ovs_interfaceid": "dc20fc88-2533-4fab-9157-8ef1a79e06a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:34:e9,bridge_name='br-int',has_traffic_filtering=True,id=dc20fc88-2533-4fab-9157-8ef1a79e06a3,network=Network(75f03656-3a5d-426c-bf1d-3b2fb46ff4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc20fc88-25') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_vif [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:34:e9,bridge_name='br-int',has_traffic_filtering=True,id=dc20fc88-2533-4fab-9157-8ef1a79e06a3,network=Network(75f03656-3a5d-426c-bf1d-3b2fb46ff4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc20fc88-25') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc20fc88-25, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:47:07 user nova-compute[73144]: INFO os_vif [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:34:e9,bridge_name='br-int',has_traffic_filtering=True,id=dc20fc88-2533-4fab-9157-8ef1a79e06a3,network=Network(75f03656-3a5d-426c-bf1d-3b2fb46ff4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc20fc88-25')
Aug 14 21:47:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMfkDCNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:07 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0587601e-20ab-41ef-b1c1-a9ac05819f93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3217c7cc-68d2-4234-b77d-f2eb828553ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:07 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:07 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:07 user nova-compute[73144]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 (non-flash)
Aug 14 21:47:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:07 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:07 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:07 user nova-compute[73144]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 (non-flash)
Aug 14 21:47:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa178365c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d886b593-764f-48ea-920d-e679a9f610bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a798c-2b2e-4301-bc65-760b8e530d9b]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[64390513-34b4-4247-b1ae-9c350fb475d1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5be0f9a-522f-4f8c-957c-da1481ffa59e]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[313a3649-1c6a-425f-9c7e-285de62b1153]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2101698b-35e2-4080-84d8-bec84b38be4b]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260]
Aug 14 21:47:07 user nova-compute[73144]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4b1956-15bb-4b08-9e79-9195a1b30fb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c90fe9a-f580-4311-828c-a50114e2f2b6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] <== disconnect_volume: return (370ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:47:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Deleting instance files /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58_del
Aug 14 21:47:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Deletion of /opt/stack/data/nova/instances/e17e5d16-9301-4788-ae7d-495c36e6df58_del complete
Aug 14 21:47:08 user nova-compute[73144]: INFO nova.compute.manager [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 14 21:47:08 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:47:08 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:47:08 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:47:08 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-be19c6e2-9a30-450b-b948-56c47d9058a9 req-3960f587-0eac-4cab-bb6e-af4da89af890 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received event network-vif-deleted-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:08 user nova-compute[73144]: INFO nova.compute.manager [req-be19c6e2-9a30-450b-b948-56c47d9058a9 req-3960f587-0eac-4cab-bb6e-af4da89af890 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Neutron deleted interface dc20fc88-2533-4fab-9157-8ef1a79e06a3; detaching it from the instance and deleting it from the info cache
Aug 14 21:47:08 user nova-compute[73144]: DEBUG nova.network.neutron [req-be19c6e2-9a30-450b-b948-56c47d9058a9 req-3960f587-0eac-4cab-bb6e-af4da89af890 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:08 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Took 0.71 seconds to deallocate network for instance.
Aug 14 21:47:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-be19c6e2-9a30-450b-b948-56c47d9058a9 req-3960f587-0eac-4cab-bb6e-af4da89af890 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Detach interface failed, port_id=dc20fc88-2533-4fab-9157-8ef1a79e06a3, reason: Instance e17e5d16-9301-4788-ae7d-495c36e6df58 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:47:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-72a6835b-6ed4-4a13-bba2-634a6fceb889 req-c2d266f1-13ce-4463-965d-4e1288996a90 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received event network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72a6835b-6ed4-4a13-bba2-634a6fceb889 req-c2d266f1-13ce-4463-965d-4e1288996a90 service nova] Acquiring lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72a6835b-6ed4-4a13-bba2-634a6fceb889 req-c2d266f1-13ce-4463-965d-4e1288996a90 service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-72a6835b-6ed4-4a13-bba2-634a6fceb889 req-c2d266f1-13ce-4463-965d-4e1288996a90 service nova] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-72a6835b-6ed4-4a13-bba2-634a6fceb889 req-c2d266f1-13ce-4463-965d-4e1288996a90 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] No waiting events found dispatching network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:09 user nova-compute[73144]: WARNING nova.compute.manager [req-72a6835b-6ed4-4a13-bba2-634a6fceb889 req-c2d266f1-13ce-4463-965d-4e1288996a90 service nova] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Received unexpected event network-vif-plugged-dc20fc88-2533-4fab-9157-8ef1a79e06a3 for instance with vm_state active and task_state deleting.
Aug 14 21:47:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Snapshot image upload complete
Aug 14 21:47:09 user nova-compute[73144]: INFO nova.compute.manager [None req-b6ab5a75-f208-4fd9-987b-eecc39fe24f9 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Took 6.85 seconds to snapshot the instance on the hypervisor.
Aug 14 21:47:09 user nova-compute[73144]: INFO nova.compute.manager [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Took 0.90 seconds to detach 1 volumes for instance.
Aug 14 21:47:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:10 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Deleted allocations for instance e17e5d16-9301-4788-ae7d-495c36e6df58
Aug 14 21:47:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7660bdd5-674f-4a92-88c3-7d25b63f10a0 tempest-DeleteServersTestJSON-253902441 tempest-DeleteServersTestJSON-253902441-project-member] Lock "e17e5d16-9301-4788-ae7d-495c36e6df58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.941s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-changed-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Refreshing instance network info cache due to event network-changed-1850f048-e688-4549-94c2-99033fbe1eae. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] Acquiring lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] Acquired lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:10 user nova-compute[73144]: DEBUG nova.network.neutron [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Refreshing network info cache for port 1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:11 user nova-compute[73144]: DEBUG nova.network.neutron [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Updated VIF entry in instance network info cache for port 1850f048-e688-4549-94c2-99033fbe1eae. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:11 user nova-compute[73144]: DEBUG nova.network.neutron [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Updating instance_info_cache with network_info: [{"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a267cfb0-fec8-404a-8f33-544bd43b34a1 req-eb1a4c19-9085-4a8c-b694-78c4aabb3c68 service nova] Releasing lock "refresh_cache-4583cc14-41a8-46b7-85d5-440efba5ec4f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'flavor' on Instance uuid 4583cc14-41a8-46b7-85d5-440efba5ec4f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:14 user nova-compute[73144]: INFO nova.compute.manager [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Attaching volume e89823fd-98a3-4308-9c1d-d40c6cfeafd4 to /dev/vdb
Aug 14 21:47:14 user nova-compute[73144]: DEBUG os_brick.utils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba3bfb-37ba-4f11-b37b-015c44548636]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5118f-02e3-4f68-ac8d-da45b2596b6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[620a2f71-dde0-4eff-9bad-7f889a9006e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[088f663d-7c79-4587-af7e-cb657fa41b34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:14 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:47:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a970a7-b337-495e-8d23-5aa52cdffa06]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG os_brick.utils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:14 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Updating existing volume attachment record: dd5df8e4-1dce-48c5-9bfc-c46f43367137 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:47:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzXraIWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:16 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:16 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:16 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6b32a2-038e-49c2-908d-41dd4643f3ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:47:16 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3929d54f-73ec-4491-acbc-2d032612fdad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21] added
Aug 14 21:47:16 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f2cdd-4000-4c77-814f-a7fc598bd6cd]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f23ae8-7d31-41d8-80b8-e4714828ac66]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzXraIWh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzXraIWh" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afff65c-a94c-4ceb-90d4-4418acca4f74]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QzXraIWh'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b579c795-f4c3-4f44-bdb6-1391c9368f22]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede1fbf3-99e8-4d7d-b8bb-e88f72dc878f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:16 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:16 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:16 user nova-compute[73144]: INFO nova.compute.manager [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Attaching volume 3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 to /dev/vdb
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1475507d-4e31-4e34-b12c-0c8c143b1270]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260]
Aug 14 21:47:16 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:16 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7920b4b1-075b-4530-a7f9-b3996b145f28]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6077446-1401-4705-98a8-9c01ad28b0d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:16 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:16 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:16 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.utils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[29640c3a-fb65-40ea-95ef-dcf3734ddb21]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzXraIWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6e8f49-c0fa-4860-8a86-3f26c0b87c70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef12e0-d459-4c14-8dbf-92a13db69d57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77956f5-683e-4c6e-930e-4cfe7fba5e46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2922c8c8-8b91-483c-bc10-0426e8c8aef3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:16 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:47:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a719720-3084-4aab-90b8-dd49d8634f73]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG os_brick.utils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:16 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating existing volume attachment record: efaeae9d-f61f-46c6-8b9a-e562167a7808 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:47:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26337343836353636', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343836353636', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:47:17 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid c16f9e34-3fc2-49c7-b0b8-99c5e5153818 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:47:17 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:17 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:47:17 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:17 user nova-compute[73144]:   <serial>bbc40de8-a398-4f35-bff3-8a4c80626d21</serial>
Aug 14 21:47:17 user nova-compute[73144]: </disk>
Aug 14 21:47:17 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:47:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No VIF found with MAC fa:16:3e:5d:e4:20, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf3ef396-13a3-4584-bf0d-56b41787704b tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.667s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:47:22 user nova-compute[73144]: INFO nova.compute.claims [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Claim successful on node user
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049627.4607992, e17e5d16-9301-4788-ae7d-495c36e6df58 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:22 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] VM Stopped (Lifecycle Event)
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-fd623072-1c43-49c5-b723-69387463e4f3 None None] [instance: e17e5d16-9301-4788-ae7d-495c36e6df58] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:47:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:47:23 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:47:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG nova.policy [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '597588abcb1a4963a536b2b078ceef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b004e49247a041b7b00500416a625ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:47:23 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Creating image(s)
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "/opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.214s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk 1073741824" returned: 0 in 0.067s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Successfully created port: 61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.215s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:47:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Cannot resize image /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'migration_context' on Instance uuid afa91ef0-a3e6-40aa-8629-2db440e4d7d2 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Ensure instance console log exists: /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Successfully updated port: 61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquired lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-changed-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Refreshing instance network info cache due to event network-changed-61bec669-dace-4e1e-953b-002031bd6e32. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] Acquiring lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBWNAihS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:25 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:25 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:25 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c3c92-b4ee-42ba-93c9-e44c83a922c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:47:25 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fcb023-c386-4fb3-ad19-3f147ee24fd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4] added
Aug 14 21:47:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.neutron [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Updating instance_info_cache with network_info: [{"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ce1e1-b9b8-4abb-933c-1e5600470fe5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Releasing lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Instance network_info: |[{"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] Acquired lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.neutron [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Refreshing network info cache for port 61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Start _get_guest_xml network_info=[{"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7378696-02ca-47bc-9711-bce632f6262b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBWNAihS {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:25 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBWNAihS" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c777148-09d4-4870-9308-c122838aa159]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GBWNAihS'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-930496660',display_name='tempest-AttachVolumeNegativeTest-server-930496660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-930496660',id=12,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs+e0vNr9zFZdrQyqaFQQgssTvFCAwymRltCoc/LO6jWAOqFindxkfDuY5F6E851UkO8ShAgOQEHiaUVcFbRNHSOIxSe+5icrcu3HZHrTflHeut0RlRkZ+W+bxOejnbOQ==',key_name='tempest-keypair-1720307920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-xlbcxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:47:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=afa91ef0-a3e6-40aa-8629-2db440e4d7d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:01:b9,bridge_name='br-int',has_traffic_filtering=True,id=61bec669-dace-4e1e-953b-002031bd6e32,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bec669-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.objects.instance [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'pci_devices' on Instance uuid afa91ef0-a3e6-40aa-8629-2db440e4d7d2 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[423027df-8db2-4918-a980-2889ba568639]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:47:25 user nova-compute[73144]:   <uuid>afa91ef0-a3e6-40aa-8629-2db440e4d7d2</uuid>
Aug 14 21:47:25 user nova-compute[73144]:   <name>instance-0000000c</name>
Aug 14 21:47:25 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:47:25 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:47:25 user nova-compute[73144]:   <metadata>
Aug 14 21:47:25 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:47:25 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:47:25 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeNegativeTest-server-930496660</nova:name>
Aug 14 21:47:25 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:47:25</nova:creationTime>
Aug 14 21:47:25 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:47:25 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:47:25 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:47:25 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:47:25 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:47:25 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:47:25 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:47:25 user nova-compute[73144]:       <nova:owner>
Aug 14 21:47:25 user nova-compute[73144]:         <nova:user uuid="597588abcb1a4963a536b2b078ceef23">tempest-AttachVolumeNegativeTest-1600069366-project-member</nova:user>
Aug 14 21:47:25 user nova-compute[73144]:         <nova:project uuid="b004e49247a041b7b00500416a625ca7">tempest-AttachVolumeNegativeTest-1600069366</nova:project>
Aug 14 21:47:25 user nova-compute[73144]:       </nova:owner>
Aug 14 21:47:25 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:47:25 user nova-compute[73144]:       <nova:ports>
Aug 14 21:47:25 user nova-compute[73144]:         <nova:port uuid="61bec669-dace-4e1e-953b-002031bd6e32">
Aug 14 21:47:25 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 21:47:25 user nova-compute[73144]:         </nova:port>
Aug 14 21:47:25 user nova-compute[73144]:       </nova:ports>
Aug 14 21:47:25 user nova-compute[73144]:     </nova:instance>
Aug 14 21:47:25 user nova-compute[73144]:   </metadata>
Aug 14 21:47:25 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:47:25 user nova-compute[73144]:     <system>
Aug 14 21:47:25 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:47:25 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:47:25 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:47:25 user nova-compute[73144]:       <entry name="serial">afa91ef0-a3e6-40aa-8629-2db440e4d7d2</entry>
Aug 14 21:47:25 user nova-compute[73144]:       <entry name="uuid">afa91ef0-a3e6-40aa-8629-2db440e4d7d2</entry>
Aug 14 21:47:25 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:47:25 user nova-compute[73144]:     </system>
Aug 14 21:47:25 user nova-compute[73144]:   </sysinfo>
Aug 14 21:47:25 user nova-compute[73144]:   <os>
Aug 14 21:47:25 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:47:25 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:47:25 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:47:25 user nova-compute[73144]:   </os>
Aug 14 21:47:25 user nova-compute[73144]:   <features>
Aug 14 21:47:25 user nova-compute[73144]:     <acpi/>
Aug 14 21:47:25 user nova-compute[73144]:     <apic/>
Aug 14 21:47:25 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:47:25 user nova-compute[73144]:   </features>
Aug 14 21:47:25 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:47:25 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:47:25 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:47:25 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:47:25 user nova-compute[73144]:   </clock>
Aug 14 21:47:25 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:47:25 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:47:25 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:47:25 user nova-compute[73144]:   </cpu>
Aug 14 21:47:25 user nova-compute[73144]:   <devices>
Aug 14 21:47:25 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:47:25 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:47:25 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk"/>
Aug 14 21:47:25 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:47:25 user nova-compute[73144]:     </disk>
Aug 14 21:47:25 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:47:25 user nova-compute[73144]:       <mac address="fa:16:3e:48:01:b9"/>
Aug 14 21:47:25 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:47:25 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:47:25 user nova-compute[73144]:       <target dev="tap61bec669-da"/>
Aug 14 21:47:25 user nova-compute[73144]:     </interface>
Aug 14 21:47:25 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:47:25 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/console.log" append="off"/>
Aug 14 21:47:25 user nova-compute[73144]:     </serial>
Aug 14 21:47:25 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:47:25 user nova-compute[73144]:     <video>
Aug 14 21:47:25 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:47:25 user nova-compute[73144]:     </video>
Aug 14 21:47:25 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:47:25 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:47:25 user nova-compute[73144]:     </rng>
Aug 14 21:47:25 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:47:25 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:47:25 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:47:25 user nova-compute[73144]:     </memballoon>
Aug 14 21:47:25 user nova-compute[73144]:   </devices>
Aug 14 21:47:25 user nova-compute[73144]: </domain>
Aug 14 21:47:25 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-930496660',display_name='tempest-AttachVolumeNegativeTest-server-930496660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-930496660',id=12,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs+e0vNr9zFZdrQyqaFQQgssTvFCAwymRltCoc/LO6jWAOqFindxkfDuY5F6E851UkO8ShAgOQEHiaUVcFbRNHSOIxSe+5icrcu3HZHrTflHeut0RlRkZ+W+bxOejnbOQ==',key_name='tempest-keypair-1720307920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-xlbcxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:47:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=afa91ef0-a3e6-40aa-8629-2db440e4d7d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:01:b9,bridge_name='br-int',has_traffic_filtering=True,id=61bec669-dace-4e1e-953b-002031bd6e32,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bec669-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_vif [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:01:b9,bridge_name='br-int',has_traffic_filtering=True,id=61bec669-dace-4e1e-953b-002031bd6e32,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bec669-da') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61bec669-da, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61bec669-da, col_values=(('external_ids', {'iface-id': '61bec669-dace-4e1e-953b-002031bd6e32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:01:b9', 'vm-uuid': 'afa91ef0-a3e6-40aa-8629-2db440e4d7d2'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f61083-0141-42ab-afed-7d15a650a732]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:25 user nova-compute[73144]: INFO os_vif [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:01:b9,bridge_name='br-int',has_traffic_filtering=True,id=61bec669-dace-4e1e-953b-002031bd6e32,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bec669-da')
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5726eba0-17f8-406e-b47e-0933657c79f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260]
Aug 14 21:47:25 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No VIF found with MAC fa:16:3e:48:01:b9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4730b9c1-eeb4-450f-826c-839973b17472]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae24fa5c-99f5-4d9d-bb49-15090338e5a7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9cc22-06b0-40bc-aca5-ccf74ec3758d]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBWNAihS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.neutron [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Updated VIF entry in instance network info cache for port 61bec669-dace-4e1e-953b-002031bd6e32. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG nova.network.neutron [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Updating instance_info_cache with network_info: [{"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c35a6528-7187-4fe2-880e-ac3859cc68d4 req-29978e82-b12c-401a-aa30-d4ea65582df3 service nova] Releasing lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-changed-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Refreshing instance network info cache due to event network-changed-c83f2c59-138d-492d-a724-3cd6fdb2dbaf. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] Acquiring lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] Acquired lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Refreshing network info cache for port c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-changed-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Refreshing instance network info cache due to event network-changed-e1162aba-89af-461b-bd63-7c862dfd9095. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] Acquiring lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] Acquired lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Refreshing network info cache for port e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lazy-loading 'flavor' on Instance uuid e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23866336632343865', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866336632343865', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'flavor' on Instance uuid 4583cc14-41a8-46b7-85d5-440efba5ec4f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:47:26 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:26 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:47:26 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:26 user nova-compute[73144]:   <serial>e89823fd-98a3-4308-9c1d-d40c6cfeafd4</serial>
Aug 14 21:47:26 user nova-compute[73144]: </disk>
Aug 14 21:47:26 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lazy-loading 'flavor' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:26 user nova-compute[73144]: INFO nova.compute.manager [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Attaching volume f54a13e7-ea2e-41a9-8615-dfe031bb6df0 to /dev/vdb
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:26 user nova-compute[73144]: INFO nova.compute.manager [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Attaching volume 713b0fce-ea05-4944-b3c3-96d090bdbd40 to /dev/vdb
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Updated VIF entry in instance network info cache for port c83f2c59-138d-492d-a724-3cd6fdb2dbaf. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Updating instance_info_cache with network_info: [{"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG os_brick.utils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-063c5fb7-f2eb-4b6d-8617-078f14465b9f req-3ef9dbb8-30df-4abd-9a86-d000b1d7a392 service nova] Releasing lock "refresh_cache-e522c4f9-2830-4f29-9c1c-17425af77440" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e577e17b-9379-41a3-b8bf-fa3ac2d0c782]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.utils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.052s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6e226-6189-4532-9230-192f3301ccbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fee712-110d-44b8-a6ff-5b3693392a78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1801b5-5145-483d-83e8-836e045f8d65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bda31b3-11d8-49a9-a92e-452f89560749]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ff33e-29f6-4c7f-a365-40a330bd8fcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399b18b-4936-4231-9dd0-3c85d9b04ab1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:27 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b938c495-0c59-4de8-9f83-3cb8bd27c9ec]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.utils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Updating existing volume attachment record: 0ee6f537-7192-49d9-9133-c10273b26cb9 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd328fc-77f6-4f35-83f0-28e1ddadcfba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:27 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ce41ec-235c-447b-877b-b613f2c8e00f]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.utils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Updating existing volume attachment record: 0fd246e7-c527-4856-9593-d27b279be2bb {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] No VIF found with MAC fa:16:3e:60:39:59, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCjNgyrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:27 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:27 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:27 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c51fb1-c2f6-411e-9a55-ec1b5392605a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:47:27 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.network.neutron [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Updated VIF entry in instance network info cache for port e1162aba-89af-461b-bd63-7c862dfd9095. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG nova.network.neutron [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Updating instance_info_cache with network_info: [{"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca4e0d7-c13e-4973-86e0-e2dbeeb757b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0] added
Aug 14 21:47:27 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be38870e-563b-4d62-8f9f-f153829ed6e6 req-88fef5f2-c39f-4c1f-9676-83deac33aef7 service nova] Releasing lock "refresh_cache-97bb9730-6643-4fa6-be15-05c6f920b2db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6449c5-b2b1-4bc2-98ce-1487604fec80]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb02fc-b7d3-40a0-97bc-28581d4b7b55]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCjNgyrv {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd5fec00-dd2e-405b-823e-b612d346de8c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.367s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCjNgyrv" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3cc3dc-b941-4141-8baa-78570628f6d9]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DCjNgyrv'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab82550-dc8c-499f-8862-e7b409c3fcf4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc01e6a-f45a-4b68-bf72-228a096e102d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:27 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:27 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:27 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed27f07-d8c7-405d-b571-cfd5b34077e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]
Aug 14 21:47:27 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:27 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3fa67e-25e3-4378-897d-9e08fe8dbd7c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fd6ec8-ace0-42df-afdf-cafcaf448cda]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:28 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae5740d-97b7-4c91-b0f7-45802bbd04ce]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCjNgyrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] Acquiring lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] No waiting events found dispatching network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:28 user nova-compute[73144]: WARNING nova.compute.manager [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received unexpected event network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 for instance with vm_state building and task_state spawning.
Aug 14 21:47:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] Acquiring lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] No waiting events found dispatching network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:28 user nova-compute[73144]: WARNING nova.compute.manager [req-0c12b234-0491-4645-9a87-d2fbb5956f9b req-f075ae3c-5b61-447e-86ae-1eb54aaf313f service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received unexpected event network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 for instance with vm_state building and task_state spawning.
Aug 14 21:47:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23065333366353466', 'path': '/dev/sdg'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065333366353466', 'path': '/dev/sdg'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:47:29 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:29 user nova-compute[73144]:   <source dev="/dev/sdg"/>
Aug 14 21:47:29 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:29 user nova-compute[73144]:   <serial>3d78c19b-023d-485d-a2d5-7a7ca3f7fde0</serial>
Aug 14 21:47:29 user nova-compute[73144]: </disk>
Aug 14 21:47:29 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No VIF found with MAC fa:16:3e:fb:d3:d3, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.compute.manager [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Detaching volume e89823fd-98a3-4308-9c1d-d40c6cfeafd4
Aug 14 21:47:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-74def248-37f3-45aa-a501-7d9b533e3132 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.488s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049649.8209813, afa91ef0-a3e6-40aa-8629-2db440e4d7d2 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] VM Resumed (Lifecycle Event)
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Instance spawned successfully.
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049649.8223717, afa91ef0-a3e6-40aa-8629-2db440e4d7d2 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] VM Started (Lifecycle Event)
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.virt.block_device [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Attempting to driver detach volume e89823fd-98a3-4308-9c1d-d40c6cfeafd4 from mountpoint /dev/vdb
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Attempting to detach device vdb from instance 4583cc14-41a8-46b7-85d5-440efba5ec4f from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:47:29 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:29 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:47:29 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:29 user nova-compute[73144]:   <serial>e89823fd-98a3-4308-9c1d-d40c6cfeafd4</serial>
Aug 14 21:47:29 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:47:29 user nova-compute[73144]: </disk>
Aug 14 21:47:29 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Successfully detached device vdb from instance 4583cc14-41a8-46b7-85d5-440efba5ec4f from the persistent domain config.
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4583cc14-41a8-46b7-85d5-440efba5ec4f from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:47:29 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:29 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:47:29 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:29 user nova-compute[73144]:   <serial>e89823fd-98a3-4308-9c1d-d40c6cfeafd4</serial>
Aug 14 21:47:29 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:47:29 user nova-compute[73144]: </disk>
Aug 14 21:47:29 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:47:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:47:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:47:30 user nova-compute[73144]: INFO nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:30 user nova-compute[73144]: INFO nova.compute.manager [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Took 7.74 seconds to build instance.
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-742217a2-b93a-454c-a893-1e3de07ffa84 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.851s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049650.4465904, 4583cc14-41a8-46b7-85d5-440efba5ec4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4583cc14-41a8-46b7-85d5-440efba5ec4f {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:47:30 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Successfully detached device vdb from instance 4583cc14-41a8-46b7-85d5-440efba5ec4f from the live domain config.
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBWNAihS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:30 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e803f-ed2c-492a-89cd-1ea7aca9af64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6870f8a6-28d1-4fe6-b807-e7baca6f07cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17850ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4'): ({'sdf'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Removing single pathed devices sdf {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a66dc-b387-4f83-a567-0c2255fd3b73]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20e2573-c2ac-4067-8206-aa76939030d4]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Flushing IO for device /dev/sdf {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a877e3a-93dc-4042-8794-7401e551d592]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c78086b5-9362-405b-87e2-4fecfc64d9b1 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c78086b5-9362-405b-87e2-4fecfc64d9b1 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.007s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c78086b5-9362-405b-87e2-4fecfc64d9b1 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c78086b5-9362-405b-87e2-4fecfc64d9b1 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73144) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c78086b5-9362-405b-87e2-4fecfc64d9b1 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.066s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8269e36-7258-403c-aff0-8d51c3ffe7f8]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e365ef05-ebee-4ef9-be39-504624f1c230]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afdf3db-c2e8-4be8-9a21-affd5d97ec11]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260]
Aug 14 21:47:30 user nova-compute[73144]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89823fd-98a3-4308-9c1d-d40c6cfeafd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c930a9-fd28-4d56-9f8c-a25279fc0e13]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] <== disconnect_volume: return (433ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a59738c-b8ce-4bd1-bfbf-ab591f25a7d2 req-cea8f44f-91e0-4c08-b255-3e7b74ddd569 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a59738c-b8ce-4bd1-bfbf-ab591f25a7d2 req-cea8f44f-91e0-4c08-b255-3e7b74ddd569 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a59738c-b8ce-4bd1-bfbf-ab591f25a7d2 req-cea8f44f-91e0-4c08-b255-3e7b74ddd569 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a59738c-b8ce-4bd1-bfbf-ab591f25a7d2 req-cea8f44f-91e0-4c08-b255-3e7b74ddd569 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a59738c-b8ce-4bd1-bfbf-ab591f25a7d2 req-cea8f44f-91e0-4c08-b255-3e7b74ddd569 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:31 user nova-compute[73144]: WARNING nova.compute.manager [req-4a59738c-b8ce-4bd1-bfbf-ab591f25a7d2 req-cea8f44f-91e0-4c08-b255-3e7b74ddd569 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state active and task_state powering-off.
Aug 14 21:47:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance destroyed successfully.
Aug 14 21:47:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c78086b5-9362-405b-87e2-4fecfc64d9b1 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c78086b5-9362-405b-87e2-4fecfc64d9b1 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.985s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG nova.objects.instance [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'flavor' on Instance uuid 4583cc14-41a8-46b7-85d5-440efba5ec4f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5ac99a31-d015-4231-8f24-9bdcd250ac7e tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.137s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-f64dd281-0f30-4ae2-993b-60d114b9b3a6 req-b18699b6-b35f-43c4-ab57-8fa6607ccb01 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f64dd281-0f30-4ae2-993b-60d114b9b3a6 req-b18699b6-b35f-43c4-ab57-8fa6607ccb01 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f64dd281-0f30-4ae2-993b-60d114b9b3a6 req-b18699b6-b35f-43c4-ab57-8fa6607ccb01 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f64dd281-0f30-4ae2-993b-60d114b9b3a6 req-b18699b6-b35f-43c4-ab57-8fa6607ccb01 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-f64dd281-0f30-4ae2-993b-60d114b9b3a6 req-b18699b6-b35f-43c4-ab57-8fa6607ccb01 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:33 user nova-compute[73144]: WARNING nova.compute.manager [req-f64dd281-0f30-4ae2-993b-60d114b9b3a6 req-b18699b6-b35f-43c4-ab57-8fa6607ccb01 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state stopped and task_state None.
Aug 14 21:47:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHBaUhfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:37 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:37 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:37 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb12b82-ee1d-4ea3-b463-7a5e329dafa0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:47:37 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9981b65-7816-4f4f-96c9-6bbe34836eae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0] added
Aug 14 21:47:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ffd7bb-dab8-4c78-b3c8-22fb461b1ee1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6c86f5-c96f-439e-bbee-e1f30cfc38ad]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHBaUhfc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHBaUhfc" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae957c-75ec-4f1c-a245-b18adea9ca15]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHBaUhfc'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9952e122-e0f5-45db-9eae-3bda120326a1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ed5e7-6a63-423a-87ae-6ddaf47a79b6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:37 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3f9259-a98d-4c8b-8741-24e628d1d13f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260]
Aug 14 21:47:38 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf75152-0d47-4ff4-8b00-9e6a13a2651d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5626d62d-558f-4442-b238-9b093b4c4c69]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[df491618-ac1f-4c61-8757-97befed58f24]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:47:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHBaUhfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23264393638363765', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264393638363765', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG nova.objects.instance [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lazy-loading 'flavor' on Instance uuid e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 21:47:39 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:39 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:47:39 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:39 user nova-compute[73144]:   <serial>f54a13e7-ea2e-41a9-8615-dfe031bb6df0</serial>
Aug 14 21:47:39 user nova-compute[73144]: </disk>
Aug 14 21:47:39 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] No VIF found with MAC fa:16:3e:58:80:0a, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-00208048-5413-4c85-9050-e7a28f9fe1c0 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.900s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:40 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1affb5dc-1ed1-4fda-85de-95de71b50716]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:47:40 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c0600-00d2-4067-9b62-142265007371]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40] added
Aug 14 21:47:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[08495db8-cb7a-4ae3-9378-cb7a7851a2f0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd9b2e-8120-4733-baf0-13aa2274cd87]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEcmYLay {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEcmYLay" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1488bd94-2818-43b0-abd3-ca9616891281]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEcmYLay'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[211fcfdb-46e6-431e-a21c-adfcad1df770]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[836dea1d-4454-4017-b7be-dc130c1e1d2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9891aaf2-9256-49fd-9128-e2c355e6029a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]
Aug 14 21:47:40 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba6591-eb39-4b39-84d3-e9b5b195c516]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c097da-1e4e-40a4-acbf-ef99f34ba62b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd51073-66fb-480e-9387-e3f630adbf90]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] volume_snapshot_create: create_info: {'snapshot_id': '6c8c3367-516d-41ae-9a28-d7c4ab43774e', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73144) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] snap xml: <domainsnapshot>
Aug 14 21:47:40 user nova-compute[73144]:   <disks>
Aug 14 21:47:40 user nova-compute[73144]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 14 21:47:40 user nova-compute[73144]:       <source file="/dev/new_file"/>
Aug 14 21:47:40 user nova-compute[73144]:     </disk>
Aug 14 21:47:40 user nova-compute[73144]:     <disk name="vda" snapshot="no"/>
Aug 14 21:47:40 user nova-compute[73144]:   </disks>
Aug 14 21:47:40 user nova-compute[73144]: </domainsnapshot>
Aug 14 21:47:40 user nova-compute[73144]:  {{(pid=73144) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG nova.objects.instance [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lazy-loading 'system_metadata' on Instance uuid e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 21:47:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-97170780-d430-49c1-b3dd-f419a394fae7 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] volume_snapshot_delete: delete_info: {'volume_id': 'f54a13e7-ea2e-41a9-8615-dfe031bb6df0'} {{(pid=73144) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [None req-97170780-d430-49c1-b3dd-f419a394fae7 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     if delete_info['type'] != 'qcow2':
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] KeyError: 'type'
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     rv = execute(f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     six.reraise(c, e, tb)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     raise value
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     rv = meth(*args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     self._volume_snapshot_create(context, instance, guest,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     rv = execute(f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     six.reraise(c, e, tb)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     raise value
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     rv = meth(*args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [instance: e522c4f9-2830-4f29-9c1c-17425af77440] 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6c8c3367-516d-41ae-9a28-d7c4ab43774e could not be found.
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6c8c3367-516d-41ae-9a28-d7c4ab43774e could not be found. (HTTP 404) (Request-ID: req-322aa49e-e0a1-47a0-a711-a6c22ec7d03a)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6c8c3367-516d-41ae-9a28-d7c4ab43774e could not be found.
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver [None req-97170780-d430-49c1-b3dd-f419a394fae7 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ec7c7b94-80bd-4e13-b739-5fd625b258a5)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 21:47:40 user nova-compute[73144]: ERROR nova.virt.libvirt.driver 
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server [None req-841c7a33-4ed0-4a99-9456-363e02893474 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server 
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server [None req-97170780-d430-49c1-b3dd-f419a394fae7 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 21:47:40 user nova-compute[73144]: ERROR oslo_messaging.rpc.server 
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:41 user nova-compute[73144]: INFO nova.compute.manager [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Detaching volume f54a13e7-ea2e-41a9-8615-dfe031bb6df0
Aug 14 21:47:41 user nova-compute[73144]: INFO nova.virt.block_device [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Attempting to driver detach volume f54a13e7-ea2e-41a9-8615-dfe031bb6df0 from mountpoint /dev/vdb
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Attempting to detach device vdb from instance e522c4f9-2830-4f29-9c1c-17425af77440 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 21:47:41 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:41 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:47:41 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:41 user nova-compute[73144]:   <serial>f54a13e7-ea2e-41a9-8615-dfe031bb6df0</serial>
Aug 14 21:47:41 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:47:41 user nova-compute[73144]: </disk>
Aug 14 21:47:41 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:47:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Successfully detached device vdb from instance e522c4f9-2830-4f29-9c1c-17425af77440 from the persistent domain config.
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e522c4f9-2830-4f29-9c1c-17425af77440 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 21:47:41 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:41 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:47:41 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:41 user nova-compute[73144]:   <serial>f54a13e7-ea2e-41a9-8615-dfe031bb6df0</serial>
Aug 14 21:47:41 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:47:41 user nova-compute[73144]: </disk>
Aug 14 21:47:41 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23539306430663166', 'path': '/dev/sdh'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539306430663166', 'path': '/dev/sdh'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.objects.instance [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lazy-loading 'flavor' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049661.5956619, e522c4f9-2830-4f29-9c1c-17425af77440 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:47:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Successfully detached device vdb from instance e522c4f9-2830-4f29-9c1c-17425af77440 from the live domain config.
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHBaUhfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:41 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:47:41 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:47:41 user nova-compute[73144]:   <source dev="/dev/sdh"/>
Aug 14 21:47:41 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:47:41 user nova-compute[73144]:   <serial>713b0fce-ea05-4944-b3c3-96d090bdbd40</serial>
Aug 14 21:47:41 user nova-compute[73144]: </disk>
Aug 14 21:47:41 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[75de54e8-0c6c-4da6-94f8-8a9c3fec5529]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc51ff71-0fea-4450-bf92-b524b12b71dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 (non-flash)
Aug 14 21:47:41 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158674160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0'): ({'sdf'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Removing single pathed devices sdf {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25abd50-10a4-4136-a461-3b68c3074805]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d0ecc7-d4f8-407c-95df-f1fd8cf9992a]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Flushing IO for device /dev/sdf {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f630696b-7383-48ed-a9a7-0127be3e600b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31681b8-26f1-4ee8-baab-a2ef17f22d7b]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[563e4f49-329c-4ce0-a575-6d3d93e59963]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c5e84-4910-4ee5-8ce7-9c665bd9657a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260]
Aug 14 21:47:41 user nova-compute[73144]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:41 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f54a13e7-ea2e-41a9-8615-dfe031bb6df0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6e2015-c3d1-4316-a554-0dba034378d0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] <== disconnect_volume: return (410ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] No VIF found with MAC fa:16:3e:a9:cf:1a, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-58f194e3-86f7-4faf-970e-79bcfbca0abc tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.287s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:47:42 user nova-compute[73144]: INFO nova.compute.claims [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Claim successful on node user
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:47:42 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.objects.instance [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lazy-loading 'flavor' on Instance uuid e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG nova.policy [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86a7e438722d4fe2b70c0546c64093d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be14e5de45434b098f04c1542b3fb835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:47:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3d4ba4dd-3af3-427d-9832-a16b9842ee47 tempest-VolumesAssistedSnapshotsTest-1221401205 tempest-VolumesAssistedSnapshotsTest-1221401205-project-admin] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:47:43 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Creating image(s)
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "/opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "/opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "/opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Successfully created port: f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.213s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk 1073741824" returned: 0 in 0.131s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG os_brick.utils [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef314f0b-bf55-41f5-b768-624bcb42c373]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f8259-1caa-4ac7-bfb7-c04bca388b4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d561fd4-9e2d-430f-a135-035e7fbf087e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e27f6b-3d5b-4ebc-b432-92394c171467]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:47:43 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af95206-d19b-4029-a0c6-3791f95dc25f]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG os_brick.utils [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:47:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:43 user nova-compute[73144]: INFO nova.compute.manager [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Swapping volume 713b0fce-ea05-4944-b3c3-96d090bdbd40 for ba759774-c99c-4dbe-9ba9-ede32144aa8d
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Cannot resize image /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lazy-loading 'migration_context' on Instance uuid 77326cfd-7f16-4dca-8216-fd42d3a7b50b {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Ensure instance console log exists: /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Successfully updated port: f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "refresh_cache-77326cfd-7f16-4dca-8216-fd42d3a7b50b" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquired lock "refresh_cache-77326cfd-7f16-4dca-8216-fd42d3a7b50b" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received event network-changed-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Refreshing instance network info cache due to event network-changed-f43a757f-377e-4de8-aae8-e0a5f5681010. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] Acquiring lock "refresh_cache-77326cfd-7f16-4dca-8216-fd42d3a7b50b" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Updating instance_info_cache with network_info: [{"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Releasing lock "refresh_cache-77326cfd-7f16-4dca-8216-fd42d3a7b50b" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Instance network_info: |[{"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] Acquired lock "refresh_cache-77326cfd-7f16-4dca-8216-fd42d3a7b50b" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Refreshing network info cache for port f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Start _get_guest_xml network_info=[{"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:47:44 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:44 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-94990191',display_name='tempest-VolumesActionsTest-instance-94990191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-94990191',id=13,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be14e5de45434b098f04c1542b3fb835',ramdisk_id='',reservation_id='r-510xsj3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-491668790',owner_user_name='tempest-VolumesActionsTest-491668790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:47:43Z,user_data=None,user_id='86a7e438722d4fe2b70c0546c64093d9',uuid=77326cfd-7f16-4dca-8216-fd42d3a7b50b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converting VIF {"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:89:eb,bridge_name='br-int',has_traffic_filtering=True,id=f43a757f-377e-4de8-aae8-e0a5f5681010,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a757f-37') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lazy-loading 'pci_devices' on Instance uuid 77326cfd-7f16-4dca-8216-fd42d3a7b50b {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:47:44 user nova-compute[73144]:   <uuid>77326cfd-7f16-4dca-8216-fd42d3a7b50b</uuid>
Aug 14 21:47:44 user nova-compute[73144]:   <name>instance-0000000d</name>
Aug 14 21:47:44 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:47:44 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:47:44 user nova-compute[73144]:   <metadata>
Aug 14 21:47:44 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:47:44 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:47:44 user nova-compute[73144]:       <nova:name>tempest-VolumesActionsTest-instance-94990191</nova:name>
Aug 14 21:47:44 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:47:44</nova:creationTime>
Aug 14 21:47:44 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:47:44 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:47:44 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:47:44 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:47:44 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:47:44 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:47:44 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:47:44 user nova-compute[73144]:       <nova:owner>
Aug 14 21:47:44 user nova-compute[73144]:         <nova:user uuid="86a7e438722d4fe2b70c0546c64093d9">tempest-VolumesActionsTest-491668790-project-member</nova:user>
Aug 14 21:47:44 user nova-compute[73144]:         <nova:project uuid="be14e5de45434b098f04c1542b3fb835">tempest-VolumesActionsTest-491668790</nova:project>
Aug 14 21:47:44 user nova-compute[73144]:       </nova:owner>
Aug 14 21:47:44 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:47:44 user nova-compute[73144]:       <nova:ports>
Aug 14 21:47:44 user nova-compute[73144]:         <nova:port uuid="f43a757f-377e-4de8-aae8-e0a5f5681010">
Aug 14 21:47:44 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:47:44 user nova-compute[73144]:         </nova:port>
Aug 14 21:47:44 user nova-compute[73144]:       </nova:ports>
Aug 14 21:47:44 user nova-compute[73144]:     </nova:instance>
Aug 14 21:47:44 user nova-compute[73144]:   </metadata>
Aug 14 21:47:44 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:47:44 user nova-compute[73144]:     <system>
Aug 14 21:47:44 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:47:44 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:47:44 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:47:44 user nova-compute[73144]:       <entry name="serial">77326cfd-7f16-4dca-8216-fd42d3a7b50b</entry>
Aug 14 21:47:44 user nova-compute[73144]:       <entry name="uuid">77326cfd-7f16-4dca-8216-fd42d3a7b50b</entry>
Aug 14 21:47:44 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:47:44 user nova-compute[73144]:     </system>
Aug 14 21:47:44 user nova-compute[73144]:   </sysinfo>
Aug 14 21:47:44 user nova-compute[73144]:   <os>
Aug 14 21:47:44 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:47:44 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:47:44 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:47:44 user nova-compute[73144]:   </os>
Aug 14 21:47:44 user nova-compute[73144]:   <features>
Aug 14 21:47:44 user nova-compute[73144]:     <acpi/>
Aug 14 21:47:44 user nova-compute[73144]:     <apic/>
Aug 14 21:47:44 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:47:44 user nova-compute[73144]:   </features>
Aug 14 21:47:44 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:47:44 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:47:44 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:47:44 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:47:44 user nova-compute[73144]:   </clock>
Aug 14 21:47:44 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:47:44 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:47:44 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:47:44 user nova-compute[73144]:   </cpu>
Aug 14 21:47:44 user nova-compute[73144]:   <devices>
Aug 14 21:47:44 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:47:44 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:47:44 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk"/>
Aug 14 21:47:44 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:47:44 user nova-compute[73144]:     </disk>
Aug 14 21:47:44 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:47:44 user nova-compute[73144]:       <mac address="fa:16:3e:6a:89:eb"/>
Aug 14 21:47:44 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:47:44 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:47:44 user nova-compute[73144]:       <target dev="tapf43a757f-37"/>
Aug 14 21:47:44 user nova-compute[73144]:     </interface>
Aug 14 21:47:44 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:47:44 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/console.log" append="off"/>
Aug 14 21:47:44 user nova-compute[73144]:     </serial>
Aug 14 21:47:44 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:47:44 user nova-compute[73144]:     <video>
Aug 14 21:47:44 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:47:44 user nova-compute[73144]:     </video>
Aug 14 21:47:44 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:47:44 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:47:44 user nova-compute[73144]:     </rng>
Aug 14 21:47:44 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:47:44 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:47:44 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:47:44 user nova-compute[73144]:     </memballoon>
Aug 14 21:47:44 user nova-compute[73144]:   </devices>
Aug 14 21:47:44 user nova-compute[73144]: </domain>
Aug 14 21:47:44 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-94990191',display_name='tempest-VolumesActionsTest-instance-94990191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-94990191',id=13,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be14e5de45434b098f04c1542b3fb835',ramdisk_id='',reservation_id='r-510xsj3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-491668790',owner_user_name='tempest-VolumesActionsTest-491668790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:47:43Z,user_data=None,user_id='86a7e438722d4fe2b70c0546c64093d9',uuid=77326cfd-7f16-4dca-8216-fd42d3a7b50b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converting VIF {"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:89:eb,bridge_name='br-int',has_traffic_filtering=True,id=f43a757f-377e-4de8-aae8-e0a5f5681010,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a757f-37') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG os_vif [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:89:eb,bridge_name='br-int',has_traffic_filtering=True,id=f43a757f-377e-4de8-aae8-e0a5f5681010,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a757f-37') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf43a757f-37, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf43a757f-37, col_values=(('external_ids', {'iface-id': 'f43a757f-377e-4de8-aae8-e0a5f5681010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:89:eb', 'vm-uuid': '77326cfd-7f16-4dca-8216-fd42d3a7b50b'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:44 user nova-compute[73144]: INFO os_vif [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:89:eb,bridge_name='br-int',has_traffic_filtering=True,id=f43a757f-377e-4de8-aae8-e0a5f5681010,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a757f-37')
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:47:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] No VIF found with MAC fa:16:3e:6a:89:eb, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:47:45 user nova-compute[73144]: DEBUG nova.network.neutron [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Updated VIF entry in instance network info cache for port f43a757f-377e-4de8-aae8-e0a5f5681010. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:47:45 user nova-compute[73144]: DEBUG nova.network.neutron [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Updating instance_info_cache with network_info: [{"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2fa1ce6a-2043-47ba-a3e0-4e042e0f7ee8 req-d7ad0183-e0dd-40f3-b8a3-f6efc0fc7869 service nova] Releasing lock "refresh_cache-77326cfd-7f16-4dca-8216-fd42d3a7b50b" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:47:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9a69831e-7f82-45ca-af91-073a720a5ce8 req-9775344e-6ffd-4e42-b079-9210f33f1202 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received event network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9a69831e-7f82-45ca-af91-073a720a5ce8 req-9775344e-6ffd-4e42-b079-9210f33f1202 service nova] Acquiring lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9a69831e-7f82-45ca-af91-073a720a5ce8 req-9775344e-6ffd-4e42-b079-9210f33f1202 service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9a69831e-7f82-45ca-af91-073a720a5ce8 req-9775344e-6ffd-4e42-b079-9210f33f1202 service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9a69831e-7f82-45ca-af91-073a720a5ce8 req-9775344e-6ffd-4e42-b079-9210f33f1202 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] No waiting events found dispatching network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:46 user nova-compute[73144]: WARNING nova.compute.manager [req-9a69831e-7f82-45ca-af91-073a720a5ce8 req-9775344e-6ffd-4e42-b079-9210f33f1202 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received unexpected event network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 for instance with vm_state building and task_state spawning.
Aug 14 21:47:46 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049651.526082, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:46 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Stopped (Lifecycle Event)
Aug 14 21:47:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c2ea588d-14c5-423d-aca7-9602c6a53f55 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c2ea588d-14c5-423d-aca7-9602c6a53f55 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049668.279524, 77326cfd-7f16-4dca-8216-fd42d3a7b50b => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] VM Resumed (Lifecycle Event)
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Instance spawned successfully.
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049668.2829742, 77326cfd-7f16-4dca-8216-fd42d3a7b50b => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] VM Started (Lifecycle Event)
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-af2d47e1-b39d-4b64-a903-1f3ffa6b96a9 req-a36407fd-fd67-4a11-a263-b460b8a18dfb service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received event network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af2d47e1-b39d-4b64-a903-1f3ffa6b96a9 req-a36407fd-fd67-4a11-a263-b460b8a18dfb service nova] Acquiring lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af2d47e1-b39d-4b64-a903-1f3ffa6b96a9 req-a36407fd-fd67-4a11-a263-b460b8a18dfb service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af2d47e1-b39d-4b64-a903-1f3ffa6b96a9 req-a36407fd-fd67-4a11-a263-b460b8a18dfb service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-af2d47e1-b39d-4b64-a903-1f3ffa6b96a9 req-a36407fd-fd67-4a11-a263-b460b8a18dfb service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] No waiting events found dispatching network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:48 user nova-compute[73144]: WARNING nova.compute.manager [req-af2d47e1-b39d-4b64-a903-1f3ffa6b96a9 req-a36407fd-fd67-4a11-a263-b460b8a18dfb service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received unexpected event network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 for instance with vm_state building and task_state spawning.
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.compute.manager [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Took 6.27 seconds to build instance.
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f32e285-5a8e-475a-9709-de82f32ba25c tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.401s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:48 user nova-compute[73144]: INFO nova.compute.manager [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Terminating instance
Aug 14 21:47:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Instance destroyed successfully.
Aug 14 21:47:49 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lazy-loading 'resources' on Instance uuid 3c176f40-fc9b-4b76-8bbb-5aaebc494599 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2012080635',display_name='tempest-VolumesActionsTest-instance-2012080635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2012080635',id=10,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bb0c2aa06bc45b08fccb6f18c12c67f',ramdisk_id='',reservation_id='r-mehdw77w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1332231170',owner_user_name='tempest-VolumesActionsTest-1332231170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:45:58Z,user_data=None,user_id='df1eea89fe1a4c86b975e25b0396c1a0',uuid=3c176f40-fc9b-4b76-8bbb-5aaebc494599,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Converting VIF {"id": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "address": "fa:16:3e:ac:67:18", "network": {"id": "92ea8945-5343-406f-8aa4-ad39548593e3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-406379736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb0c2aa06bc45b08fccb6f18c12c67f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bf4874-52", "ovs_interfaceid": "b9bf4874-52b4-4f3f-8f07-debfa604caef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:67:18,bridge_name='br-int',has_traffic_filtering=True,id=b9bf4874-52b4-4f3f-8f07-debfa604caef,network=Network(92ea8945-5343-406f-8aa4-ad39548593e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bf4874-52') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG os_vif [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:67:18,bridge_name='br-int',has_traffic_filtering=True,id=b9bf4874-52b4-4f3f-8f07-debfa604caef,network=Network(92ea8945-5343-406f-8aa4-ad39548593e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bf4874-52') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9bf4874-52, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:49 user nova-compute[73144]: INFO os_vif [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:67:18,bridge_name='br-int',has_traffic_filtering=True,id=b9bf4874-52b4-4f3f-8f07-debfa604caef,network=Network(92ea8945-5343-406f-8aa4-ad39548593e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bf4874-52')
Aug 14 21:47:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Deleting instance files /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599_del
Aug 14 21:47:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Deletion of /opt/stack/data/nova/instances/3c176f40-fc9b-4b76-8bbb-5aaebc494599_del complete
Aug 14 21:47:49 user nova-compute[73144]: INFO nova.compute.manager [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 21:47:49 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:47:49 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received event network-vif-unplugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] Acquiring lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] No waiting events found dispatching network-vif-unplugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received event network-vif-unplugged-b9bf4874-52b4-4f3f-8f07-debfa604caef for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received event network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] Acquiring lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] No waiting events found dispatching network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:47:50 user nova-compute[73144]: WARNING nova.compute.manager [req-078b3a6a-bc2d-417c-8b62-39f4a75af7c9 req-a4e23ae3-6c3d-4e65-9e12-8dd71a50ed9d service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received unexpected event network-vif-plugged-b9bf4874-52b4-4f3f-8f07-debfa604caef for instance with vm_state active and task_state deleting.
Aug 14 21:47:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:47:50 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Took 0.86 seconds to deallocate network for instance.
Aug 14 21:47:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-24cfd85f-1f1b-4d30-a822-00fda23676e3 req-6c51780a-6b13-416d-bed9-2802b1330cda service nova] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Received event network-vif-deleted-b9bf4874-52b4-4f3f-8f07-debfa604caef {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:51 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:47:51 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:47:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:51 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Deleted allocations for instance 3c176f40-fc9b-4b76-8bbb-5aaebc494599
Aug 14 21:47:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b53b0ebb-ec94-439e-959e-7e24da9de429 tempest-VolumesActionsTest-1332231170 tempest-VolumesActionsTest-1332231170-project-member] Lock "3c176f40-fc9b-4b76-8bbb-5aaebc494599" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG nova.compute.manager [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDtBWVPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97bb9730-6643-4fa6-be15-05c6f920b2db', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba759774-c99c-4dbe-9ba9-ede32144aa8d', 'serial': 'ba759774-c99c-4dbe-9ba9-ede32144aa8d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '97bb9730-6643-4fa6-be15-05c6f920b2db', 'attached_at': '', 'detached_at': '', 'volume_id': '713b0fce-ea05-4944-b3c3-96d090bdbd40', 'serial'} {{(pid=73144) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDtBWVPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:53 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:53 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:53 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7bf5dc-06dc-48ff-9521-99e4a9f6879f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:47:53 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacc8515-8094-41f9-8aca-8b0863904525]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d] added
Aug 14 21:47:53 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[105ca805-6892-4d99-a1bc-0aed124d0f09]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d8dea-0051-486e-8d03-e1598f4b78bb]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDtBWVPr {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDtBWVPr" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4b5ef0-863c-4dde-8620-290eb9c26c50]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wDtBWVPr'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.126s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ac53f-c1f6-4477-9d4c-533df849e12b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad11cb0-63d3-4ad2-8130-7c1ded9402bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ad55c6-8a01-43ea-8942-387c1b808ad2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260]
Aug 14 21:47:54 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260] successful.
Aug 14 21:47:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fa4838-c6c6-41b4-9287-d2c7253f0802]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c078e6-9be8-48b4-8df4-3d4c36f67ecb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c7db73-bfc5-4f82-a826-5e3aa1a901f0]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDtBWVPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:47:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26233333032393634', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233333032393634', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG nova.objects.instance [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lazy-loading 'flavor' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 12582912 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 165675008 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 351272960 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 572522496 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 725614592 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 878706688 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 1028653056 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:47:59 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:59 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7160MB free_disk=25.572067260742188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:47:59 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ae3ee52c-0811-4c67-a43e-736e02c5511d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4583cc14-41a8-46b7-85d5-440efba5ec4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e522c4f9-2830-4f29-9c1c-17425af77440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 97bb9730-6643-4fa6-be15-05c6f920b2db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 94b0537b-818e-4ce5-9175-b3d9014b6afa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance afa91ef0-a3e6-40aa-8629-2db440e4d7d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 77326cfd-7f16-4dca-8216-fd42d3a7b50b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f0c7b4-09a1-4428-bb93-16599ae4bfd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[74220da6-2397-4404-8bda-34eb0659158c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:47:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158675630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'): ({'sdh'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Removing single pathed devices sdh {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:47:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c925fbd-5fb1-4136-b78a-274c4f78cc03]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[87429ee7-89ac-4189-b1ed-d1b575df8caf]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Flushing IO for device /dev/sdh {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc35b1fd-e070-4886-bb30-5d02aa5fe5ca]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2adc5-b4cd-4bd9-930b-b890c0ad2d09]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] SCSI volumes sdh have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab3858-651a-410a-b791-7472d37716f8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf0bf72-e64b-4329-8869-9c1c3fb74ea5]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]
Aug 14 21:48:00 user nova-compute[73144]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.
Aug 14 21:48:00 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[498daf37-6bc3-41c3-afce-57d92cf62c96]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] <== disconnect_volume: return (365ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDtBWVPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '97bb9730-6643-4fa6-be15-05c6f920b2db', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba759774-c99c-4dbe-9ba9-ede32144aa8d', 'serial'} {{(pid=73144) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] swap_volume: removing Cinder connection for volume 713b0fce-ea05-4944-b3c3-96d090bdbd40 {{(pid=73144) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 21:48:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] swap_volume: Updating volume 713b0fce-ea05-4944-b3c3-96d090bdbd40 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "wDtBWVPr", "auth_password": "7CjRNFDt4wgOve", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "ba759774-c99c-4dbe-9ba9-ede32144aa8d"}, "status": "reserved", "instance": "97bb9730-6643-4fa6-be15-05c6f920b2db", "attached_at": "", "detached_at": "", "volume_id": "ba759774-c99c-4dbe-9ba9-ede32144aa8d", "serial": "ba759774-c99c-4dbe-9ba9-ede32144aa8d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ba759774-c99c-4dbe-9ba9-ede32144aa8d', 'no_device': None, 'attachment_id': '56791417-3755-433e-87da-6cd361fcfab4'} {{(pid=73144) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-79dcf542-8d22-4762-b769-8cd4d7cbf203 tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.456s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG os_brick.utils [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18e5fb2-5636-43dc-a9bc-608817dd4b88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d3c3b7-12c6-4871-97de-66bb7e76d28b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f28fc6-0f31-486f-9d58-3c5ae9eabe35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[858fadac-5a76-4f67-a002-a78c247e8f1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:48:02 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:48:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dde788-91ce-487c-a9e5-0892b5cd888c]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:48:02 user nova-compute[73144]: DEBUG os_brick.utils [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:02 user nova-compute[73144]: INFO nova.compute.manager [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Swapping volume ba759774-c99c-4dbe-9ba9-ede32144aa8d for 713b0fce-ea05-4944-b3c3-96d090bdbd40
Aug 14 21:48:04 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049669.676446, 3c176f40-fc9b-4b76-8bbb-5aaebc494599 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:48:04 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] VM Stopped (Lifecycle Event)
Aug 14 21:48:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-42ee06dc-8cf2-4292-998d-0bf34600d7ed None None] [instance: 3c176f40-fc9b-4b76-8bbb-5aaebc494599] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:48:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-changed-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing instance network info cache due to event network-changed-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] Acquiring lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] Acquired lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Refreshing network info cache for port 0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97bb9730-6643-4fa6-be15-05c6f920b2db', 'attached_at': '', 'detached_at': '', 'volume_id': '713b0fce-ea05-4944-b3c3-96d090bdbd40', 'serial': '713b0fce-ea05-4944-b3c3-96d090bdbd40'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDtBWVPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ba759774-c99c-4dbe-9ba9-ede32144aa8d'}, 'status': 'reserved', 'instance': '97bb9730-6643-4fa6-be15-05c6f920b2db', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba759774-c99c-4dbe-9ba9-ede32144aa8d', 'serial'} {{(pid=73144) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:12 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:48:12 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:48:12 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc75700-5acf-4f3e-b26a-b19f553157c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:48:12 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc810d03-5f05-435a-a1cb-2bac06088a10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40] added
Aug 14 21:48:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b77bfa-b7d5-4136-97fe-536ef3ad9a33]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ae7e43-d406-4426-a3a4-71b8b3c5bcd8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEcmYLay {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEcmYLay" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ff5194-cb1a-4879-9934-9c7027f965ba]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEcmYLay'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a0578b-88cc-4fca-8715-4ad82bbbb6b7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3509dea2-b302-4631-88ec-2e3c4f03b695]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[905c00aa-d8fa-4da7-addc-c32cbaf4f3c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]
Aug 14 21:48:12 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.
Aug 14 21:48:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb57643-c970-4c3d-b7ef-e9cc0e0eb639]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25dfd6-d468-4b44-8f17-7b3c90813c8f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b22ba5-85ca-42d9-bd1f-9e7633714757]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updated VIF entry in instance network info cache for port 0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [{"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:48:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9e5a3a81-0675-4b18-a8b3-e97cbda0195c req-43c70d1b-bf9a-451e-9d5a-5ac015226d00 service nova] Releasing lock "refresh_cache-94b0537b-818e-4ce5-9175-b3d9014b6afa" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:48:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23539306430663166', 'path': '/dev/sdh'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539306430663166', 'path': '/dev/sdh'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:48:13 user nova-compute[73144]: DEBUG nova.objects.instance [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lazy-loading 'flavor' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 188743680 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:14 user nova-compute[73144]: INFO nova.compute.manager [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Terminating instance
Aug 14 21:48:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 364904448 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-d73b9043-d244-4591-ba66-60da1d12548e req-a1034266-e7e7-4a51-9f8c-e676c9aa43cc service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d73b9043-d244-4591-ba66-60da1d12548e req-a1034266-e7e7-4a51-9f8c-e676c9aa43cc service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d73b9043-d244-4591-ba66-60da1d12548e req-a1034266-e7e7-4a51-9f8c-e676c9aa43cc service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d73b9043-d244-4591-ba66-60da1d12548e req-a1034266-e7e7-4a51-9f8c-e676c9aa43cc service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-d73b9043-d244-4591-ba66-60da1d12548e req-a1034266-e7e7-4a51-9f8c-e676c9aa43cc service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-unplugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-d73b9043-d244-4591-ba66-60da1d12548e req-a1034266-e7e7-4a51-9f8c-e676c9aa43cc service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-31d6d9e4-8f80-4e0c-a493-f381dd8ef097 req-32d13107-1771-4dea-bf6e-08cc59e627da service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-31d6d9e4-8f80-4e0c-a493-f381dd8ef097 req-32d13107-1771-4dea-bf6e-08cc59e627da service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-31d6d9e4-8f80-4e0c-a493-f381dd8ef097 req-32d13107-1771-4dea-bf6e-08cc59e627da service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-31d6d9e4-8f80-4e0c-a493-f381dd8ef097 req-32d13107-1771-4dea-bf6e-08cc59e627da service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-31d6d9e4-8f80-4e0c-a493-f381dd8ef097 req-32d13107-1771-4dea-bf6e-08cc59e627da service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-unplugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-31d6d9e4-8f80-4e0c-a493-f381dd8ef097 req-32d13107-1771-4dea-bf6e-08cc59e627da service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-d780433b-e1b5-40f2-a208-78ca927f2b59 req-2e0cadb5-ac72-4c1d-b80a-21a686c781fa service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d780433b-e1b5-40f2-a208-78ca927f2b59 req-2e0cadb5-ac72-4c1d-b80a-21a686c781fa service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d780433b-e1b5-40f2-a208-78ca927f2b59 req-2e0cadb5-ac72-4c1d-b80a-21a686c781fa service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d780433b-e1b5-40f2-a208-78ca927f2b59 req-2e0cadb5-ac72-4c1d-b80a-21a686c781fa service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-d780433b-e1b5-40f2-a208-78ca927f2b59 req-2e0cadb5-ac72-4c1d-b80a-21a686c781fa service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-unplugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-d780433b-e1b5-40f2-a208-78ca927f2b59 req-2e0cadb5-ac72-4c1d-b80a-21a686c781fa service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-7c34f297-7cee-4930-913e-d23e4e0ce730 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 517996544 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 792723456 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Instance destroyed successfully.
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lazy-loading 'resources' on Instance uuid 94b0537b-818e-4ce5-9175-b3d9014b6afa {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:2c:ee,bridge_name='br-int',has_traffic_filtering=True,id=0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea,network=Network(62826183-eb6e-42e2-808e-9387f475c27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df2c88f-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:2c:ee,bridge_name='br-int',has_traffic_filtering=True,id=0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea,network=Network(62826183-eb6e-42e2-808e-9387f475c27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df2c88f-1d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0df2c88f-1d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: INFO os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:2c:ee,bridge_name='br-int',has_traffic_filtering=True,id=0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea,network=Network(62826183-eb6e-42e2-808e-9387f475c27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df2c88f-1d')
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=dfc8d9a0-97bf-4a69-bdf3-0072178b15a5,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc8d9a0-97') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=dfc8d9a0-97bf-4a69-bdf3-0072178b15a5,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc8d9a0-97') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc8d9a0-97, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: INFO os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=dfc8d9a0-97bf-4a69-bdf3-0072178b15a5,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc8d9a0-97')
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f9:1a,bridge_name='br-int',has_traffic_filtering=True,id=010e5966-6fd5-4fa8-bb29-1a4aaa80c8af,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap010e5966-6f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f9:1a,bridge_name='br-int',has_traffic_filtering=True,id=010e5966-6fd5-4fa8-bb29-1a4aaa80c8af,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap010e5966-6f') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap010e5966-6f, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: INFO os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f9:1a,bridge_name='br-int',has_traffic_filtering=True,id=010e5966-6fd5-4fa8-bb29-1a4aaa80c8af,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap010e5966-6f')
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=7c34f297-7cee-4930-913e-d23e4e0ce730,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c34f297-7c') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=7c34f297-7cee-4930-913e-d23e4e0ce730,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c34f297-7c') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c34f297-7c, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 932184064 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: INFO os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=7c34f297-7cee-4930-913e-d23e4e0ce730,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c34f297-7c')
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "f0bdae5c-0379-40e5-825d-3f427e72500f", "address": "fa:16:3e:8e:e7:00", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdae5c-03", "ovs_interfaceid": "f0bdae5c-0379-40e5-825d-3f427e72500f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=f0bdae5c-0379-40e5-825d-3f427e72500f,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdae5c-03') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=f0bdae5c-0379-40e5-825d-3f427e72500f,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdae5c-03') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0bdae5c-03, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: INFO os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:00,bridge_name='br-int',has_traffic_filtering=True,id=f0bdae5c-0379-40e5-825d-3f427e72500f,network=Network(a5ebb506-1c50-48b8-b0d6-af0f66911036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdae5c-03')
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=6d244fe2-f52b-40fb-8ccf-cf2b7956f08b,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244fe2-f5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=6d244fe2-f52b-40fb-8ccf-cf2b7956f08b,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244fe2-f5') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d244fe2-f5, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: INFO os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=6d244fe2-f52b-40fb-8ccf-cf2b7956f08b,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244fe2-f5')
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-526590275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-526590275',id=11,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHzxgbS7/WK8HGtKUAwVxh02j5lj6vXOFqV9ekk7sD3Orm4LzOUDcoG4OihmXxemljRK8e2tZ1DZ7wgwutdp+Nrsd3TkDHaietg5CgmQs6ar9lQltLrvD/mGpgtBKwEZQ==',key_name='tempest-keypair-154393925',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6708546a68844379bb72703ef7489d1',ramdisk_id='',reservation_id='r-awu2pujy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1166239274',owner_user_name='tempest-TaggedBootDevicesTest-1166239274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c618c44614454cbcc49fd12f4024b1',uuid=94b0537b-818e-4ce5-9175-b3d9014b6afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converting VIF {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:60:39,bridge_name='br-int',has_traffic_filtering=True,id=ee36fb49-f455-497d-b96e-e1a1d4d464d9,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee36fb49-f4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:60:39,bridge_name='br-int',has_traffic_filtering=True,id=ee36fb49-f455-497d-b96e-e1a1d4d464d9,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee36fb49-f4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee36fb49-f4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:17 user nova-compute[73144]: INFO os_vif [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:60:39,bridge_name='br-int',has_traffic_filtering=True,id=ee36fb49-f455-497d-b96e-e1a1d4d464d9,network=Network(458b2207-4484-4ea7-8f5a-4f36b0071cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee36fb49-f4')
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PErdMvCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdfb542-2e19-42a9-9f48-1bbc8b589327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89933d5-87f0-4e80-ace7-9be25dcebc67]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586753f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a26404-a0e7-494c-ae81-b0083873858e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a00d89-1f30-4f34-b51c-bcdfd6e9a6f2]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f4a6d5-df05-4eb6-85ee-d243b3e74465]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9818e4-932d-4a1f-958e-a80af775fe4c]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea for instance with vm_state active and task_state deleting.
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-unplugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING nova.compute.manager [req-c9253034-eb0d-4c95-a520-7f19d02c2d0e req-b98bab18-b44f-407e-82c3-ad409e57b9f6 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-dfc8d9a0-97bf-4a69-bdf3-0072178b15a5 for instance with vm_state active and task_state deleting.
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[525089c6-80bf-4ce0-953c-f664a34f0755]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 1072693248 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-7c34f297-7cee-4930-913e-d23e4e0ce730 for instance with vm_state active and task_state deleting.
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-unplugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-ee36fb49-f455-497d-b96e-e1a1d4d464d9 for instance with vm_state active and task_state deleting.
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-unplugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING nova.compute.manager [req-96fca173-9615-4503-b580-067fb73a0449 req-8566d9d3-5624-4816-af7d-02998742f520 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b for instance with vm_state active and task_state deleting.
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-010e5966-6fd5-4fa8-bb29-1a4aaa80c8af for instance with vm_state active and task_state deleting.
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-unplugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-unplugged-f0bdae5c-0379-40e5-825d-3f427e72500f for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Acquiring lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] No waiting events found dispatching network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING nova.compute.manager [req-a12c96b0-b5ca-43f9-b390-66c267073ec0 req-f3cac957-43a2-432c-bfd0-aa08fe5f1c79 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received unexpected event network-vif-plugged-f0bdae5c-0379-40e5-825d-3f427e72500f for instance with vm_state active and task_state deleting.
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b93a7-4dcb-4e05-b6e2-6ce83151f834]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260]
Aug 14 21:48:17 user nova-compute[73144]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe, portal: 172.16.0.220,3260] successful.
Aug 14 21:48:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2e2404e-60ab-4662-88e0-90c2d2794abe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[552c6c6a-a2f3-4256-bff6-6ea8305af298]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== disconnect_volume: return (438ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klTFyQhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:17 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f055d1a8-b8b9-47f9-a5cd-9f3615244512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27ef6a0-c5ff-4a72-b815-26d660835b2d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158689cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbfbfe3-7672-4471-b9fc-9b05b86a4aaf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[902f1b9b-2793-4e98-ae3b-a6f5ea7b5832]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[68699ecf-3126-4183-90a1-67c620a7192a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d557385-aae3-4984-ac3e-96b45a90c581]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc2392-5f9d-427b-8405-dacd78c1ea17]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc93343f-52f0-4106-bc71-a792591512b0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260]
Aug 14 21:48:17 user nova-compute[73144]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c, portal: 172.16.0.220,3260] successful.
Aug 14 21:48:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbcd2919-73a1-44b5-8d44-7c4435a1392c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a312b7-1e88-4741-9fe4-b38b33296ff5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== disconnect_volume: return (299ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SngYfIjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:18 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b8b20a-03a0-4959-8102-db6444891d92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d212c-f018-4d62-8d1a-f711046c9761]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158684b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f10181c-9667-4ccb-9d32-9acb63046be9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d3f9a9-86df-4836-9a9e-0f3e59f33fba]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2af0d4-150c-4d08-be6e-f520403051ec]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06fe9c-64c3-467f-8495-c996887c60be]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a8a45-b7bb-4286-9541-ddb271423dbb]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDtBWVPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ba759774-c99c-4dbe-9ba9-ede32144aa8d'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:18 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[609da39d-7f97-4f4f-bfa2-108bb97a1337]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260]
Aug 14 21:48:18 user nova-compute[73144]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448, portal: 172.16.0.220,3260] successful.
Aug 14 21:48:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b67e0522-d784-4cbc-9a8c-465480082448 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6973ef2b-21f0-4700-bbdd-02504e2dc98e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] <== disconnect_volume: return (282ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:48:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Deleting instance files /opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa_del
Aug 14 21:48:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Deletion of /opt/stack/data/nova/instances/94b0537b-818e-4ce5-9175-b3d9014b6afa_del complete
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.055s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e98df0-0926-40c3-b5c8-ff2454880cec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b995a-8fbe-41f8-8ce1-23f4022525c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa18c3e3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d'): ({'sdf'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Removing single pathed devices sdf {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: INFO nova.compute.manager [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Took 3.65 seconds to destroy the instance on the hypervisor.
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28ed32-d5a3-46c0-ac8b-833404299d82]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[704196fc-b29e-4488-913a-cd6bba21f234]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Flushing IO for device /dev/sdf {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[234a9635-9a60-4c28-89be-7b4ccf334f06]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ab8e2-7bde-407f-b394-70bf69fb499d]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d4e505-c922-4d58-aa58-b9550e21181d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[731e9d23-0375-4cb1-b951-bd2e03558892]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260]
Aug 14 21:48:18 user nova-compute[73144]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d, portal: 172.16.0.220,3260] successful.
Aug 14 21:48:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba759774-c99c-4dbe-9ba9-ede32144aa8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e91f7-0aed-428e-8971-ff3e514ac114]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] <== disconnect_volume: return (343ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '97bb9730-6643-4fa6-be15-05c6f920b2db', 'attached_at': '', 'detached_at': '', 'volume_id': '713b0fce-ea05-4944-b3c3-96d090bdbd40', 'serial'} {{(pid=73144) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 21:48:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] swap_volume: removing Cinder connection for volume ba759774-c99c-4dbe-9ba9-ede32144aa8d {{(pid=73144) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 21:48:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-26138b94-3d8d-40db-b083-fa6a6f392aee req-feb9d381-8000-4571-ace0-7654a6c64815 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-deleted-f0bdae5c-0379-40e5-825d-3f427e72500f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:20 user nova-compute[73144]: INFO nova.compute.manager [req-26138b94-3d8d-40db-b083-fa6a6f392aee req-feb9d381-8000-4571-ace0-7654a6c64815 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Neutron deleted interface f0bdae5c-0379-40e5-825d-3f427e72500f; detaching it from the instance and deleting it from the info cache
Aug 14 21:48:20 user nova-compute[73144]: DEBUG nova.network.neutron [req-26138b94-3d8d-40db-b083-fa6a6f392aee req-feb9d381-8000-4571-ace0-7654a6c64815 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [{"id": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "address": "fa:16:3e:75:2c:ee", "network": {"id": "62826183-eb6e-42e2-808e-9387f475c27d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1586682077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df2c88f-1d", "ovs_interfaceid": "0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "address": "fa:16:3e:5c:f9:81", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc8d9a0-97", "ovs_interfaceid": "dfc8d9a0-97bf-4a69-bdf3-0072178b15a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "address": "fa:16:3e:56:f9:1a", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010e5966-6f", "ovs_interfaceid": "010e5966-6fd5-4fa8-bb29-1a4aaa80c8af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c34f297-7cee-4930-913e-d23e4e0ce730", "address": "fa:16:3e:2e:13:ba", "network": {"id": "a5ebb506-1c50-48b8-b0d6-af0f66911036", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337265465", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c34f297-7c", "ovs_interfaceid": "7c34f297-7cee-4930-913e-d23e4e0ce730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "address": "fa:16:3e:57:e6:37", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244fe2-f5", "ovs_interfaceid": "6d244fe2-f52b-40fb-8ccf-cf2b7956f08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "address": "fa:16:3e:76:60:39", "network": {"id": "458b2207-4484-4ea7-8f5a-4f36b0071cc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1986333329", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6708546a68844379bb72703ef7489d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee36fb49-f4", "ovs_interfaceid": "ee36fb49-f455-497d-b96e-e1a1d4d464d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:48:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-26138b94-3d8d-40db-b083-fa6a6f392aee req-feb9d381-8000-4571-ace0-7654a6c64815 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Detach interface failed, port_id=f0bdae5c-0379-40e5-825d-3f427e72500f, reason: Instance 94b0537b-818e-4ce5-9175-b3d9014b6afa could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:48:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:48:21 user nova-compute[73144]: INFO nova.compute.claims [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Claim successful on node user
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:48:21 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:48:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.policy [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '894a50b95060455fb7702b1216f2adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea8cc08442546c29ea4a251995ea832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:48:22 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Took 3.68 seconds to deallocate network for instance.
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:48:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Creating image(s)
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "/opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "/opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-1ae53ed9-484d-4f35-a4d5-6826f4e50c2b req-e7a5c779-0f47-4b4c-8654-4c36546ffce4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-deleted-0df2c88f-1df5-41b8-bf30-a1cf9aaa49ea {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-1ae53ed9-484d-4f35-a4d5-6826f4e50c2b req-e7a5c779-0f47-4b4c-8654-4c36546ffce4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-deleted-6d244fe2-f52b-40fb-8ccf-cf2b7956f08b {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-1ae53ed9-484d-4f35-a4d5-6826f4e50c2b req-e7a5c779-0f47-4b4c-8654-4c36546ffce4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-deleted-7c34f297-7cee-4930-913e-d23e4e0ce730 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-1ae53ed9-484d-4f35-a4d5-6826f4e50c2b req-e7a5c779-0f47-4b4c-8654-4c36546ffce4 service nova] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Received event network-vif-deleted-ee36fb49-f455-497d-b96e-e1a1d4d464d9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.168s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk 1073741824" returned: 0 in 0.056s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Successfully created port: fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Cannot resize image /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'migration_context' on Instance uuid 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Ensure instance console log exists: /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Successfully updated port: fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "refresh_cache-8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquired lock "refresh_cache-8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Received event network-changed-fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Refreshing instance network info cache due to event network-changed-fe94a210-b468-40c0-be9e-a3a3c86f047a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:48:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] Acquiring lock "refresh_cache-8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] swap_volume: Updating volume ba759774-c99c-4dbe-9ba9-ede32144aa8d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "sEcmYLay", "auth_password": "ES3WXQlV7yLqeo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "713b0fce-ea05-4944-b3c3-96d090bdbd40"}, "status": "reserved", "instance": "97bb9730-6643-4fa6-be15-05c6f920b2db", "attached_at": "", "detached_at": "", "volume_id": "713b0fce-ea05-4944-b3c3-96d090bdbd40", "serial": "713b0fce-ea05-4944-b3c3-96d090bdbd40"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '713b0fce-ea05-4944-b3c3-96d090bdbd40', 'no_device': None, 'attachment_id': '83f1d9cd-211a-471a-82b0-3df8756f1b87'} {{(pid=73144) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Updating instance_info_cache with network_info: [{"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9476406e-78c0-41f8-bc35-59644fb707cb tempest-TestVolumeSwap-1419421901 tempest-TestVolumeSwap-1419421901-project-admin] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.836s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Releasing lock "refresh_cache-8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Instance network_info: |[{"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] Acquired lock "refresh_cache-8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Refreshing network info cache for port fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Start _get_guest_xml network_info=[{"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:48:24 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:48:24 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-993661882',display_name='tempest-VolumesAdminNegativeTest-server-993661882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-993661882',id=14,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ea8cc08442546c29ea4a251995ea832',ramdisk_id='',reservation_id='r-frto9fha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-177118256',owner_user_name='tempest-VolumesAdminNegativeTest-177118256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:48:22Z,user_data=None,user_id='894a50b95060455fb7702b1216f2adf4',uuid=8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converting VIF {"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ea:17,bridge_name='br-int',has_traffic_filtering=True,id=fe94a210-b468-40c0-be9e-a3a3c86f047a,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe94a210-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:48:24 user nova-compute[73144]:   <uuid>8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e</uuid>
Aug 14 21:48:24 user nova-compute[73144]:   <name>instance-0000000e</name>
Aug 14 21:48:24 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:48:24 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:48:24 user nova-compute[73144]:   <metadata>
Aug 14 21:48:24 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:48:24 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:48:24 user nova-compute[73144]:       <nova:name>tempest-VolumesAdminNegativeTest-server-993661882</nova:name>
Aug 14 21:48:24 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:48:24</nova:creationTime>
Aug 14 21:48:24 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:48:24 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:48:24 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:48:24 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:48:24 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:48:24 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:48:24 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:48:24 user nova-compute[73144]:       <nova:owner>
Aug 14 21:48:24 user nova-compute[73144]:         <nova:user uuid="894a50b95060455fb7702b1216f2adf4">tempest-VolumesAdminNegativeTest-177118256-project-member</nova:user>
Aug 14 21:48:24 user nova-compute[73144]:         <nova:project uuid="7ea8cc08442546c29ea4a251995ea832">tempest-VolumesAdminNegativeTest-177118256</nova:project>
Aug 14 21:48:24 user nova-compute[73144]:       </nova:owner>
Aug 14 21:48:24 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:48:24 user nova-compute[73144]:       <nova:ports>
Aug 14 21:48:24 user nova-compute[73144]:         <nova:port uuid="fe94a210-b468-40c0-be9e-a3a3c86f047a">
Aug 14 21:48:24 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 21:48:24 user nova-compute[73144]:         </nova:port>
Aug 14 21:48:24 user nova-compute[73144]:       </nova:ports>
Aug 14 21:48:24 user nova-compute[73144]:     </nova:instance>
Aug 14 21:48:24 user nova-compute[73144]:   </metadata>
Aug 14 21:48:24 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:48:24 user nova-compute[73144]:     <system>
Aug 14 21:48:24 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:48:24 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:48:24 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:48:24 user nova-compute[73144]:       <entry name="serial">8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e</entry>
Aug 14 21:48:24 user nova-compute[73144]:       <entry name="uuid">8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e</entry>
Aug 14 21:48:24 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:48:24 user nova-compute[73144]:     </system>
Aug 14 21:48:24 user nova-compute[73144]:   </sysinfo>
Aug 14 21:48:24 user nova-compute[73144]:   <os>
Aug 14 21:48:24 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:48:24 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:48:24 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:48:24 user nova-compute[73144]:   </os>
Aug 14 21:48:24 user nova-compute[73144]:   <features>
Aug 14 21:48:24 user nova-compute[73144]:     <acpi/>
Aug 14 21:48:24 user nova-compute[73144]:     <apic/>
Aug 14 21:48:24 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:48:24 user nova-compute[73144]:   </features>
Aug 14 21:48:24 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:48:24 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:48:24 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:48:24 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:48:24 user nova-compute[73144]:   </clock>
Aug 14 21:48:24 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:48:24 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:48:24 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:48:24 user nova-compute[73144]:   </cpu>
Aug 14 21:48:24 user nova-compute[73144]:   <devices>
Aug 14 21:48:24 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:48:24 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:48:24 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk"/>
Aug 14 21:48:24 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:48:24 user nova-compute[73144]:     </disk>
Aug 14 21:48:24 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:48:24 user nova-compute[73144]:       <mac address="fa:16:3e:29:ea:17"/>
Aug 14 21:48:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:48:24 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:48:24 user nova-compute[73144]:       <target dev="tapfe94a210-b4"/>
Aug 14 21:48:24 user nova-compute[73144]:     </interface>
Aug 14 21:48:24 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:48:24 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/console.log" append="off"/>
Aug 14 21:48:24 user nova-compute[73144]:     </serial>
Aug 14 21:48:24 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:48:24 user nova-compute[73144]:     <video>
Aug 14 21:48:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:48:24 user nova-compute[73144]:     </video>
Aug 14 21:48:24 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:48:24 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:48:24 user nova-compute[73144]:     </rng>
Aug 14 21:48:24 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:48:24 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:48:24 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:48:24 user nova-compute[73144]:     </memballoon>
Aug 14 21:48:24 user nova-compute[73144]:   </devices>
Aug 14 21:48:24 user nova-compute[73144]: </domain>
Aug 14 21:48:24 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-993661882',display_name='tempest-VolumesAdminNegativeTest-server-993661882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-993661882',id=14,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ea8cc08442546c29ea4a251995ea832',ramdisk_id='',reservation_id='r-frto9fha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-177118256',owner_user_name='tempest-VolumesAdminNegativeTest-177118256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:48:22Z,user_data=None,user_id='894a50b95060455fb7702b1216f2adf4',uuid=8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converting VIF {"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ea:17,bridge_name='br-int',has_traffic_filtering=True,id=fe94a210-b468-40c0-be9e-a3a3c86f047a,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe94a210-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG os_vif [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ea:17,bridge_name='br-int',has_traffic_filtering=True,id=fe94a210-b468-40c0-be9e-a3a3c86f047a,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe94a210-b4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe94a210-b4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe94a210-b4, col_values=(('external_ids', {'iface-id': 'fe94a210-b468-40c0-be9e-a3a3c86f047a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:ea:17', 'vm-uuid': '8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:24 user nova-compute[73144]: INFO os_vif [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ea:17,bridge_name='br-int',has_traffic_filtering=True,id=fe94a210-b468-40c0-be9e-a3a3c86f047a,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe94a210-b4')
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] No VIF found with MAC fa:16:3e:29:ea:17, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:48:24 user nova-compute[73144]: INFO nova.compute.manager [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Took 2.30 seconds to detach 3 volumes for instance.
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Updated VIF entry in instance network info cache for port fe94a210-b468-40c0-be9e-a3a3c86f047a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Updating instance_info_cache with network_info: [{"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f2ddb84b-fcd2-4d52-be38-b75c738bd54c req-51f8bd5f-572f-4eb6-a065-bb667634eebf service nova] Releasing lock "refresh_cache-8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:24 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Deleted allocations for instance 94b0537b-818e-4ce5-9175-b3d9014b6afa
Aug 14 21:48:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b20bdacd-2c7c-4cb7-8556-0e1758fd7396 tempest-TaggedBootDevicesTest-1166239274 tempest-TaggedBootDevicesTest-1166239274-project-member] Lock "94b0537b-818e-4ce5-9175-b3d9014b6afa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.227s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:25 user nova-compute[73144]: INFO nova.compute.manager [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Detaching volume 713b0fce-ea05-4944-b3c3-96d090bdbd40
Aug 14 21:48:25 user nova-compute[73144]: INFO nova.virt.block_device [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Attempting to driver detach volume 713b0fce-ea05-4944-b3c3-96d090bdbd40 from mountpoint /dev/vdb
Aug 14 21:48:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Attempting to detach device vdb from instance 97bb9730-6643-4fa6-be15-05c6f920b2db from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:48:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:48:25 user nova-compute[73144]:   <source dev="/dev/sdh"/>
Aug 14 21:48:25 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:48:25 user nova-compute[73144]:   <serial>713b0fce-ea05-4944-b3c3-96d090bdbd40</serial>
Aug 14 21:48:25 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:48:25 user nova-compute[73144]: </disk>
Aug 14 21:48:25 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:48:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Successfully detached device vdb from instance 97bb9730-6643-4fa6-be15-05c6f920b2db from the persistent domain config.
Aug 14 21:48:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97bb9730-6643-4fa6-be15-05c6f920b2db from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:48:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:48:25 user nova-compute[73144]:   <source dev="/dev/sdh"/>
Aug 14 21:48:25 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:48:25 user nova-compute[73144]:   <serial>713b0fce-ea05-4944-b3c3-96d090bdbd40</serial>
Aug 14 21:48:25 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:48:25 user nova-compute[73144]: </disk>
Aug 14 21:48:25 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-ac8fa037-60d4-4b9e-8992-c9694aec2c34 req-7f39ab83-672f-4af9-a966-79bd28d86601 service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Received event network-vif-plugged-fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ac8fa037-60d4-4b9e-8992-c9694aec2c34 req-7f39ab83-672f-4af9-a966-79bd28d86601 service nova] Acquiring lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ac8fa037-60d4-4b9e-8992-c9694aec2c34 req-7f39ab83-672f-4af9-a966-79bd28d86601 service nova] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ac8fa037-60d4-4b9e-8992-c9694aec2c34 req-7f39ab83-672f-4af9-a966-79bd28d86601 service nova] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-ac8fa037-60d4-4b9e-8992-c9694aec2c34 req-7f39ab83-672f-4af9-a966-79bd28d86601 service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] No waiting events found dispatching network-vif-plugged-fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:25 user nova-compute[73144]: WARNING nova.compute.manager [req-ac8fa037-60d4-4b9e-8992-c9694aec2c34 req-7f39ab83-672f-4af9-a966-79bd28d86601 service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Received unexpected event network-vif-plugged-fe94a210-b468-40c0-be9e-a3a3c86f047a for instance with vm_state building and task_state spawning.
Aug 14 21:48:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049706.225612, 97bb9730-6643-4fa6-be15-05c6f920b2db => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:48:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Successfully detached device vdb from instance 97bb9730-6643-4fa6-be15-05c6f920b2db from the live domain config.
Aug 14 21:48:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcmYLay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '713b0fce-ea05-4944-b3c3-96d090bdbd40'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:26 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b46e5d3-4bb9-4a9a-8d63-04e98571570b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a9b1d-8613-4f3c-9429-051f2368978b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:26 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:26 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 (non-flash)
Aug 14 21:48:26 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:48:26 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:48:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17832c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40'): ({'sdh'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Removing single pathed devices sdh {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d241118-c174-49f4-a8e9-881d36268c95]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9919f9ef-6b1f-40ef-b95c-7200863e48d3]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Flushing IO for device /dev/sdh {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24ae08-b14c-4223-85ac-92e477c0d697]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b031ef-7d00-405c-a768-03923387d672]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] SCSI volumes sdh have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce0be95-37e1-480b-86c9-71e3bc30540b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[65411c11-b037-4be3-8037-ce20d1515b3d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260]
Aug 14 21:48:26 user nova-compute[73144]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40, portal: 172.16.0.220,3260] successful.
Aug 14 21:48:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713b0fce-ea05-4944-b3c3-96d090bdbd40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d06b1-322e-4400-b39e-c6e227fe58f4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] <== disconnect_volume: return (267ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:48:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lazy-loading 'flavor' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0fa23fc-b92a-4ed6-b83e-14c70e2ba70b tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.615s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-5db6979a-9747-42c3-98ed-f7406f2730ec req-3425b349-27a7-43e3-a686-a56c55d0754a service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Received event network-vif-plugged-fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5db6979a-9747-42c3-98ed-f7406f2730ec req-3425b349-27a7-43e3-a686-a56c55d0754a service nova] Acquiring lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5db6979a-9747-42c3-98ed-f7406f2730ec req-3425b349-27a7-43e3-a686-a56c55d0754a service nova] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5db6979a-9747-42c3-98ed-f7406f2730ec req-3425b349-27a7-43e3-a686-a56c55d0754a service nova] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-5db6979a-9747-42c3-98ed-f7406f2730ec req-3425b349-27a7-43e3-a686-a56c55d0754a service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] No waiting events found dispatching network-vif-plugged-fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:27 user nova-compute[73144]: WARNING nova.compute.manager [req-5db6979a-9747-42c3-98ed-f7406f2730ec req-3425b349-27a7-43e3-a686-a56c55d0754a service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Received unexpected event network-vif-plugged-fe94a210-b468-40c0-be9e-a3a3c86f047a for instance with vm_state building and task_state spawning.
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049708.162719, 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:48:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] VM Resumed (Lifecycle Event)
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:48:28 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Instance spawned successfully.
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:48:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049708.1651013, 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:48:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] VM Started (Lifecycle Event)
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:48:28 user nova-compute[73144]: INFO nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 14 21:48:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:48:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:48:28 user nova-compute[73144]: INFO nova.compute.manager [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Took 7.03 seconds to build instance.
Aug 14 21:48:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-75ae036d-cab5-47bb-9407-b4a11e8fedf3 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.120s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:31 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049696.7259343, 94b0537b-818e-4ce5-9175-b3d9014b6afa => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:48:31 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] VM Stopped (Lifecycle Event)
Aug 14 21:48:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-37a7cc73-49e8-4381-9543-4ce210eae841 None None] [instance: 94b0537b-818e-4ce5-9175-b3d9014b6afa] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:48:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:38 user nova-compute[73144]: INFO nova.compute.manager [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Terminating instance
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-62399a4b-06ff-4fee-b6c2-595df70d498d req-393f83d3-85ca-4b5b-89dd-690ee1cf9ffa service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-vif-unplugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-62399a4b-06ff-4fee-b6c2-595df70d498d req-393f83d3-85ca-4b5b-89dd-690ee1cf9ffa service nova] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-62399a4b-06ff-4fee-b6c2-595df70d498d req-393f83d3-85ca-4b5b-89dd-690ee1cf9ffa service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-62399a4b-06ff-4fee-b6c2-595df70d498d req-393f83d3-85ca-4b5b-89dd-690ee1cf9ffa service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-62399a4b-06ff-4fee-b6c2-595df70d498d req-393f83d3-85ca-4b5b-89dd-690ee1cf9ffa service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] No waiting events found dispatching network-vif-unplugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-62399a4b-06ff-4fee-b6c2-595df70d498d req-393f83d3-85ca-4b5b-89dd-690ee1cf9ffa service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-vif-unplugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:48:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Instance destroyed successfully.
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lazy-loading 'resources' on Instance uuid e522c4f9-2830-4f29-9c1c-17425af77440 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-573106279',display_name='tempest-VolumesAssistedSnapshotsTest-server-573106279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-573106279',id=8,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM8lbDI94TQ/etw9iA55fLXxSz2Gr6e4uXmSdNhXGaYoof/PejXCzbhb7d8paEiOc3I3ueWNrTrVa13NMs7ng8GxHkZmu2TEpG+jr6k9KeJ1ZGgz4c+UCOoYK0rn4f+3g==',key_name='tempest-keypair-575572244',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b26313e6174cdb9cc7461661811382',ramdisk_id='',reservation_id='r-u1fus3v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1184426792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1184426792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee9862d25eb4fa1b7eae15b7770f60d',uuid=e522c4f9-2830-4f29-9c1c-17425af77440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Converting VIF {"id": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "address": "fa:16:3e:58:80:0a", "network": {"id": "8d0bd10e-1f55-4999-b6f1-63aaa8366aa0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-301147874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b26313e6174cdb9cc7461661811382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83f2c59-13", "ovs_interfaceid": "c83f2c59-138d-492d-a724-3cd6fdb2dbaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:80:0a,bridge_name='br-int',has_traffic_filtering=True,id=c83f2c59-138d-492d-a724-3cd6fdb2dbaf,network=Network(8d0bd10e-1f55-4999-b6f1-63aaa8366aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83f2c59-13') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG os_vif [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:80:0a,bridge_name='br-int',has_traffic_filtering=True,id=c83f2c59-138d-492d-a724-3cd6fdb2dbaf,network=Network(8d0bd10e-1f55-4999-b6f1-63aaa8366aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83f2c59-13') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83f2c59-13, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:38 user nova-compute[73144]: INFO os_vif [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:80:0a,bridge_name='br-int',has_traffic_filtering=True,id=c83f2c59-138d-492d-a724-3cd6fdb2dbaf,network=Network(8d0bd10e-1f55-4999-b6f1-63aaa8366aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83f2c59-13')
Aug 14 21:48:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Deleting instance files /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440_del
Aug 14 21:48:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Deletion of /opt/stack/data/nova/instances/e522c4f9-2830-4f29-9c1c-17425af77440_del complete
Aug 14 21:48:38 user nova-compute[73144]: INFO nova.compute.manager [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 21:48:38 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:48:38 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:48:39 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:48:39 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Took 0.82 seconds to deallocate network for instance.
Aug 14 21:48:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:40 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Deleted allocations for instance e522c4f9-2830-4f29-9c1c-17425af77440
Aug 14 21:48:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f7778c7-5d68-4fa1-90b6-54d17b4035f6 tempest-VolumesAssistedSnapshotsTest-1184426792 tempest-VolumesAssistedSnapshotsTest-1184426792-project-member] Lock "e522c4f9-2830-4f29-9c1c-17425af77440" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-41c0a8c9-594d-4500-9d4d-c4f14e159d6b req-2aaa0e8e-e528-43cf-a65c-f3aad7cce194 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41c0a8c9-594d-4500-9d4d-c4f14e159d6b req-2aaa0e8e-e528-43cf-a65c-f3aad7cce194 service nova] Acquiring lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41c0a8c9-594d-4500-9d4d-c4f14e159d6b req-2aaa0e8e-e528-43cf-a65c-f3aad7cce194 service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41c0a8c9-594d-4500-9d4d-c4f14e159d6b req-2aaa0e8e-e528-43cf-a65c-f3aad7cce194 service nova] Lock "e522c4f9-2830-4f29-9c1c-17425af77440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-41c0a8c9-594d-4500-9d4d-c4f14e159d6b req-2aaa0e8e-e528-43cf-a65c-f3aad7cce194 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] No waiting events found dispatching network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:48:40 user nova-compute[73144]: WARNING nova.compute.manager [req-41c0a8c9-594d-4500-9d4d-c4f14e159d6b req-2aaa0e8e-e528-43cf-a65c-f3aad7cce194 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received unexpected event network-vif-plugged-c83f2c59-138d-492d-a724-3cd6fdb2dbaf for instance with vm_state deleted and task_state None.
Aug 14 21:48:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-41c0a8c9-594d-4500-9d4d-c4f14e159d6b req-2aaa0e8e-e528-43cf-a65c-f3aad7cce194 service nova] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Received event network-vif-deleted-c83f2c59-138d-492d-a724-3cd6fdb2dbaf {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'flavor' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:52 user nova-compute[73144]: INFO nova.compute.manager [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Attaching volume 5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 to /dev/vdb
Aug 14 21:48:53 user nova-compute[73144]: DEBUG os_brick.utils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7eba6-ce1f-4be1-964f-36ecfb2a86fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[02778b0f-9deb-4016-b26a-6812ffc1c0e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b00f561-a288-4425-8e28-3b09dd679567]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6eb022-8c8b-47c5-a89b-ad45a7daf17d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:48:53 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:48:53 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd901b8-dd0e-4656-84ae-3495bc88854b]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG os_brick.utils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating existing volume attachment record: f95dc1d7-07d1-426b-bc9b-c18f07cddd34 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049718.8727267, e522c4f9-2830-4f29-9c1c-17425af77440 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:48:53 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] VM Stopped (Lifecycle Event)
Aug 14 21:48:53 user nova-compute[73144]: DEBUG nova.compute.manager [None req-7beb2273-14ab-4a72-8099-d8d5096f721d None None] [instance: e522c4f9-2830-4f29-9c1c-17425af77440] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:48:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:54 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:48:56 user nova-compute[73144]: INFO nova.compute.claims [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Claim successful on node user
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'flavor' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.780s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:57 user nova-compute[73144]: INFO nova.compute.manager [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Attaching volume 3e42c18f-690a-4fd0-a365-b8e7bbbf4329 to /dev/vdb
Aug 14 21:48:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:48:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG os_brick.utils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[db889b6d-992c-48d9-aee6-d1fe8d2c4a96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e575b690-3c3e-47cc-991f-941ac50b8b8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d6fed-2dd2-41a1-98ef-6eb1b0c4c2b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd00595-68c0-4906-9d51-ac5064af835b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG nova.policy [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f236788f6a93453b893ddf6d4cf01c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2005f37baf4b1b99effc98fddd0fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:48:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Creating image(s)
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:48:58 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac135563-120e-4fe2-93c8-4517d7c33449]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG os_brick.utils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== get_connector_properties: return (237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating existing volume attachment record: c6389e5f-c989-48b8-ac30-d6a3ad7755fa {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.256s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk 1073741824" returned: 0 in 0.072s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Successfully created port: 6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:48:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Cannot resize image /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'migration_context' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Ensure instance console log exists: /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Successfully updated port: 6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquired lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-changed-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Refreshing instance network info cache due to event network-changed-6f7e06eb-2d48-431d-9305-24dc4801c99a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] Acquiring lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:48:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updating instance_info_cache with network_info: [{"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Releasing lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance network_info: |[{"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] Acquired lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.network.neutron [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Refreshing network info cache for port 6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Start _get_guest_xml network_info=[{"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:49:00 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:00 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7528MB free_disk=25.52263641357422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:00 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:00 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1593031860',display_name='tempest-tempest.common.compute-instance-1593031860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1593031860',id=15,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqCumZ/fmgKOc7IfkPXpmLzqkGmsWcfXH/aHSLL63EIDPCYrbA7aV6dRIW5fpx+mmgIckHG/r4NRGJy6RPYUzNm64l35X06MrWUIA4QzuIwUkrvl1av/AdaNxdmexJsw==',key_name='tempest-keypair-1493275970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-ffz2q41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=ea802951-a15c-4dac-a693-4fe96ef3cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'pci_devices' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:49:00 user nova-compute[73144]:   <uuid>ea802951-a15c-4dac-a693-4fe96ef3cc9f</uuid>
Aug 14 21:49:00 user nova-compute[73144]:   <name>instance-0000000f</name>
Aug 14 21:49:00 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:49:00 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:49:00 user nova-compute[73144]:   <metadata>
Aug 14 21:49:00 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:49:00 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:49:00 user nova-compute[73144]:       <nova:name>tempest-tempest.common.compute-instance-1593031860</nova:name>
Aug 14 21:49:00 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:49:00</nova:creationTime>
Aug 14 21:49:00 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:49:00 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:49:00 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:49:00 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:49:00 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:49:00 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:49:00 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:49:00 user nova-compute[73144]:       <nova:owner>
Aug 14 21:49:00 user nova-compute[73144]:         <nova:user uuid="f236788f6a93453b893ddf6d4cf01c1c">tempest-ServerActionsTestOtherA-202206255-project-member</nova:user>
Aug 14 21:49:00 user nova-compute[73144]:         <nova:project uuid="fe2005f37baf4b1b99effc98fddd0fdc">tempest-ServerActionsTestOtherA-202206255</nova:project>
Aug 14 21:49:00 user nova-compute[73144]:       </nova:owner>
Aug 14 21:49:00 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:49:00 user nova-compute[73144]:       <nova:ports>
Aug 14 21:49:00 user nova-compute[73144]:         <nova:port uuid="6f7e06eb-2d48-431d-9305-24dc4801c99a">
Aug 14 21:49:00 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 21:49:00 user nova-compute[73144]:         </nova:port>
Aug 14 21:49:00 user nova-compute[73144]:       </nova:ports>
Aug 14 21:49:00 user nova-compute[73144]:     </nova:instance>
Aug 14 21:49:00 user nova-compute[73144]:   </metadata>
Aug 14 21:49:00 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:49:00 user nova-compute[73144]:     <system>
Aug 14 21:49:00 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:49:00 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:49:00 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:49:00 user nova-compute[73144]:       <entry name="serial">ea802951-a15c-4dac-a693-4fe96ef3cc9f</entry>
Aug 14 21:49:00 user nova-compute[73144]:       <entry name="uuid">ea802951-a15c-4dac-a693-4fe96ef3cc9f</entry>
Aug 14 21:49:00 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:49:00 user nova-compute[73144]:     </system>
Aug 14 21:49:00 user nova-compute[73144]:   </sysinfo>
Aug 14 21:49:00 user nova-compute[73144]:   <os>
Aug 14 21:49:00 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:49:00 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:49:00 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:49:00 user nova-compute[73144]:   </os>
Aug 14 21:49:00 user nova-compute[73144]:   <features>
Aug 14 21:49:00 user nova-compute[73144]:     <acpi/>
Aug 14 21:49:00 user nova-compute[73144]:     <apic/>
Aug 14 21:49:00 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:49:00 user nova-compute[73144]:   </features>
Aug 14 21:49:00 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:49:00 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:49:00 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:49:00 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:49:00 user nova-compute[73144]:   </clock>
Aug 14 21:49:00 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:49:00 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:49:00 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:49:00 user nova-compute[73144]:   </cpu>
Aug 14 21:49:00 user nova-compute[73144]:   <devices>
Aug 14 21:49:00 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:49:00 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:49:00 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk"/>
Aug 14 21:49:00 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:49:00 user nova-compute[73144]:     </disk>
Aug 14 21:49:00 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:49:00 user nova-compute[73144]:       <mac address="fa:16:3e:4a:bd:e4"/>
Aug 14 21:49:00 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:00 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:49:00 user nova-compute[73144]:       <target dev="tap6f7e06eb-2d"/>
Aug 14 21:49:00 user nova-compute[73144]:     </interface>
Aug 14 21:49:00 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:49:00 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/console.log" append="off"/>
Aug 14 21:49:00 user nova-compute[73144]:     </serial>
Aug 14 21:49:00 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:49:00 user nova-compute[73144]:     <video>
Aug 14 21:49:00 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:00 user nova-compute[73144]:     </video>
Aug 14 21:49:00 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:49:00 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:49:00 user nova-compute[73144]:     </rng>
Aug 14 21:49:00 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:49:00 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:49:00 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:49:00 user nova-compute[73144]:     </memballoon>
Aug 14 21:49:00 user nova-compute[73144]:   </devices>
Aug 14 21:49:00 user nova-compute[73144]: </domain>
Aug 14 21:49:00 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1593031860',display_name='tempest-tempest.common.compute-instance-1593031860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1593031860',id=15,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqCumZ/fmgKOc7IfkPXpmLzqkGmsWcfXH/aHSLL63EIDPCYrbA7aV6dRIW5fpx+mmgIckHG/r4NRGJy6RPYUzNm64l35X06MrWUIA4QzuIwUkrvl1av/AdaNxdmexJsw==',key_name='tempest-keypair-1493275970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-ffz2q41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=ea802951-a15c-4dac-a693-4fe96ef3cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG os_vif [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f7e06eb-2d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f7e06eb-2d, col_values=(('external_ids', {'iface-id': '6f7e06eb-2d48-431d-9305-24dc4801c99a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:bd:e4', 'vm-uuid': 'ea802951-a15c-4dac-a693-4fe96ef3cc9f'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:00 user nova-compute[73144]: INFO os_vif [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d')
Aug 14 21:49:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ae3ee52c-0811-4c67-a43e-736e02c5511d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4583cc14-41a8-46b7-85d5-440efba5ec4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 97bb9730-6643-4fa6-be15-05c6f920b2db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance afa91ef0-a3e6-40aa-8629-2db440e4d7d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 77326cfd-7f16-4dca-8216-fd42d3a7b50b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ea802951-a15c-4dac-a693-4fe96ef3cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No VIF found with MAC fa:16:3e:4a:bd:e4, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:49:01 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:49:01 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:49:01 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:49:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:01 user nova-compute[73144]: DEBUG nova.network.neutron [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updated VIF entry in instance network info cache for port 6f7e06eb-2d48-431d-9305-24dc4801c99a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:49:01 user nova-compute[73144]: DEBUG nova.network.neutron [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updating instance_info_cache with network_info: [{"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b708ae62-d5a1-4514-aff0-ba4dc52f082d req-a573e54d-77ad-4bd1-b6d2-67c6dc65a40b service nova] Releasing lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-92c08ed8-3be1-416a-997d-5960094cf980 req-ed080f0a-5ab3-41f8-b383-974de47ea7ef service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-92c08ed8-3be1-416a-997d-5960094cf980 req-ed080f0a-5ab3-41f8-b383-974de47ea7ef service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-92c08ed8-3be1-416a-997d-5960094cf980 req-ed080f0a-5ab3-41f8-b383-974de47ea7ef service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-92c08ed8-3be1-416a-997d-5960094cf980 req-ed080f0a-5ab3-41f8-b383-974de47ea7ef service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-92c08ed8-3be1-416a-997d-5960094cf980 req-ed080f0a-5ab3-41f8-b383-974de47ea7ef service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:02 user nova-compute[73144]: WARNING nova.compute.manager [req-92c08ed8-3be1-416a-997d-5960094cf980 req-ed080f0a-5ab3-41f8-b383-974de47ea7ef service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received unexpected event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with vm_state building and task_state spawning.
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCrOxIuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:03 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:03 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:03 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[339f3e5a-3aa6-4cfe-b8a9-b86d0e149231]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:49:03 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[838428b8-5307-43a1-a006-e34e388810e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676] added
Aug 14 21:49:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[13974463-a29e-497b-ba97-fbb85aff1062]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7868f67f-f3fb-45fb-97d5-f3fc912145ad]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCrOxIuM {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCrOxIuM" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c03680a-2430-4ded-a2bf-a7abeb51bc33]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCrOxIuM'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dad6c36-d896-4cdc-b4f2-33f6283df024]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8bc7aa-c53e-44c7-af34-40f7445f9aae]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5004c4d3-8df0-42a5-b374-e38bafcca2bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260]
Aug 14 21:49:03 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260] successful.
Aug 14 21:49:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6befab2d-c1ea-4629-b40e-f918267afc69]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3adb7c1-07fb-4cde-a9f0-fc1e7b464889]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8b62e3-4196-4cef-8d7a-f15ebd6beb67]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCrOxIuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:49:03 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049744.710633, ea802951-a15c-4dac-a693-4fe96ef3cc9f => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] VM Resumed (Lifecycle Event)
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:49:04 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance spawned successfully.
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-09cfed05-bc0c-4112-8394-79dc19268ceb req-02e71b8a-5e70-47a9-a6d8-95577c0f8fe1 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-09cfed05-bc0c-4112-8394-79dc19268ceb req-02e71b8a-5e70-47a9-a6d8-95577c0f8fe1 service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-09cfed05-bc0c-4112-8394-79dc19268ceb req-02e71b8a-5e70-47a9-a6d8-95577c0f8fe1 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-09cfed05-bc0c-4112-8394-79dc19268ceb req-02e71b8a-5e70-47a9-a6d8-95577c0f8fe1 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-09cfed05-bc0c-4112-8394-79dc19268ceb req-02e71b8a-5e70-47a9-a6d8-95577c0f8fe1 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:04 user nova-compute[73144]: WARNING nova.compute.manager [req-09cfed05-bc0c-4112-8394-79dc19268ceb req-02e71b8a-5e70-47a9-a6d8-95577c0f8fe1 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received unexpected event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with vm_state building and task_state spawning.
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:49:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049744.7110426, ea802951-a15c-4dac-a693-4fe96ef3cc9f => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] VM Started (Lifecycle Event)
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:49:04 user nova-compute[73144]: INFO nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Took 6.77 seconds to spawn the instance on the hypervisor.
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26136306362366133', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136306362366133', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'flavor' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:49:04 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:49:04 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:49:04 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:49:04 user nova-compute[73144]:   <serial>5a5bdd80-3b54-4849-9e4a-f1bbf3fff676</serial>
Aug 14 21:49:04 user nova-compute[73144]: </disk>
Aug 14 21:49:04 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:49:04 user nova-compute[73144]: INFO nova.compute.manager [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Took 8.17 seconds to build instance.
Aug 14 21:49:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bb3bb668-447d-40d7-af40-75d95f41b871 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.287s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No VIF found with MAC fa:16:3e:31:42:f6, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:49:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b1e7a4e4-42fe-4238-9bd4-aac11f4d2ed8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.711s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:06 user nova-compute[73144]: INFO nova.compute.manager [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Rescuing
Aug 14 21:49:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:49:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:06 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:49:07 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-6f418281-fdca-4576-859b-42d9514e6c44 req-6d0e7fb8-a358-4938-8c5a-568e2204bf3a service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6f418281-fdca-4576-859b-42d9514e6c44 req-6d0e7fb8-a358-4938-8c5a-568e2204bf3a service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6f418281-fdca-4576-859b-42d9514e6c44 req-6d0e7fb8-a358-4938-8c5a-568e2204bf3a service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6f418281-fdca-4576-859b-42d9514e6c44 req-6d0e7fb8-a358-4938-8c5a-568e2204bf3a service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-6f418281-fdca-4576-859b-42d9514e6c44 req-6d0e7fb8-a358-4938-8c5a-568e2204bf3a service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:08 user nova-compute[73144]: WARNING nova.compute.manager [req-6f418281-fdca-4576-859b-42d9514e6c44 req-6d0e7fb8-a358-4938-8c5a-568e2204bf3a service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state active and task_state rescuing.
Aug 14 21:49:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance destroyed successfully.
Aug 14 21:49:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Attempting a stable device rescue
Aug 14 21:49:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73144) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 21:49:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Creating image(s)
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "656c7d6c5cd467600ec723f03e7d2656e16a06e1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "656c7d6c5cd467600ec723f03e7d2656e16a06e1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:09 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:09 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:09 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bcaa2e-ef23-427e-9521-916daf04e5dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:49:09 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.057s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ccf17-3ef3-4f30-89f3-aa67d5eae6ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329] added
Aug 14 21:49:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[505fb08d-34b8-491a-aa9e-785fb195ce9c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[49844918-f83a-4d98-ab65-d831ec98a068]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG nova.virt.images [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] 05ef81e5-031e-4b51-b607-15bfdb286da8 was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.part /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTYcpkGm {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTYcpkGm" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e72c4c-a2d1-44d5-ac39-077b6acd6991]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTYcpkGm'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09657dfa-ba58-4146-8d1a-77b1439b9612]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c031c6-a6a0-4929-a02c-61d23a7ae62b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:09 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:09 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:09 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:09 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57bdd40-3a5c-4d70-87f9-654e2b584715]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]
Aug 14 21:49:09 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.
Aug 14 21:49:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.075s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5e99e-c576-4edf-b69b-006583332923]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3267168-d17f-43d4-bee6-3214b32fc7a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:10 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.511s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb82f4cc-a17b-41f3-b67d-08d98dfa5132 req-996ce858-85b5-4a86-b743-72f9c0438d4b service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb82f4cc-a17b-41f3-b67d-08d98dfa5132 req-996ce858-85b5-4a86-b743-72f9c0438d4b service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb82f4cc-a17b-41f3-b67d-08d98dfa5132 req-996ce858-85b5-4a86-b743-72f9c0438d4b service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb82f4cc-a17b-41f3-b67d-08d98dfa5132 req-996ce858-85b5-4a86-b743-72f9c0438d4b service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb82f4cc-a17b-41f3-b67d-08d98dfa5132 req-996ce858-85b5-4a86-b743-72f9c0438d4b service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:10 user nova-compute[73144]: WARNING nova.compute.manager [req-cb82f4cc-a17b-41f3-b67d-08d98dfa5132 req-996ce858-85b5-4a86-b743-72f9c0438d4b service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state active and task_state rescuing.
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a52618a-1b3a-407f-82a8-1bf83d9c4487]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.part /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.converted" returned: 0 in 0.474s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1.converted --force-share --output=json" returned: 0 in 0.256s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "656c7d6c5cd467600ec723f03e7d2656e16a06e1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.037s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "656c7d6c5cd467600ec723f03e7d2656e16a06e1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "656c7d6c5cd467600ec723f03e7d2656e16a06e1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1 --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1,backing_fmt=raw /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.rescue {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1,backing_fmt=raw /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.rescue" returned: 0 in 0.049s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "656c7d6c5cd467600ec723f03e7d2656e16a06e1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'migration_context' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Start _get_guest_xml network_info=[{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "vif_mac": "fa:16:3e:31:42:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '05ef81e5-031e-4b51-b607-15bfdb286da8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'f95dc1d7-07d1-426b-bc9b-c18f07cddd34', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCrOxIuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ae3ee52c-0811-4c67-a43e-736e02c5511d', 'attached_at': '', 'detached_at': '', 'volume_id': '5a5bdd80-3b54-4849-9e4a-f1bbf3fff676', 'serial': '5a5bdd80-3b54-4849-9e4a-f1bbf3fff676'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'resources' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'numa_topology' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:10 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:10 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCrOxIuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:10 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.559s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== connect_volume: return (1562ms) {'type': 'block', 'scsi_wwn': '26237626263303761', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237626263303761', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.264s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:11 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:11 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'flavor' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b113c1-11bb-4fcc-bee5-3eb32b786371]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mCrOxIuM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 21:49:11 user nova-compute[73144]: node.name = iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676
Aug 14 21:49:11 user nova-compute[73144]: node.tpgt = -1
Aug 14 21:49:11 user nova-compute[73144]: node.startup = automatic
Aug 14 21:49:11 user nova-compute[73144]: node.leading_login = No
Aug 14 21:49:11 user nova-compute[73144]: iface.iscsi_ifacename = default
Aug 14 21:49:11 user nova-compute[73144]: iface.net_ifacename = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.ipaddress = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.prefix_len = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.hwaddress = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.transport_name = tcp
Aug 14 21:49:11 user nova-compute[73144]: iface.initiatorname = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.state = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.vlan_id = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.vlan_priority = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.vlan_state = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.iface_num = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.mtu = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.port = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.bootproto = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.subnet_mask = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.gateway = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_alt_client_id = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_dns = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_learn_iqn = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_vendor_id_state = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_vendor_id = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.dhcp_slp_da = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.fragmentation = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.gratuitous_arp = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.incoming_forwarding = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.tos_state = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.tos = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.ttl = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.delayed_ack = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.tcp_nagle = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.tcp_wsf_state = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.tcp_wsf = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.tcp_timer_scale = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.tcp_timestamp = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.redirect = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.def_task_mgmt_timeout = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.header_digest = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.data_digest = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.immediate_data = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.initial_r2t = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.data_seq_inorder = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.data_pdu_inorder = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.erl = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.max_receive_data_len = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.first_burst_len = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.max_outstanding_r2t = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.max_burst_len = 0
Aug 14 21:49:11 user nova-compute[73144]: iface.chap_auth = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.bidi_chap = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.strict_login_compliance = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.discovery_auth = <empty>
Aug 14 21:49:11 user nova-compute[73144]: iface.discovery_logout = <empty>
Aug 14 21:49:11 user nova-compute[73144]: node.discovery_address = <empty>
Aug 14 21:49:11 user nova-compute[73144]: node.discovery_port = 0
Aug 14 21:49:11 user nova-compute[73144]: node.discovery_type = static
Aug 14 21:49:11 user nova-compute[73144]: node.session.initial_cmdsn = 0
Aug 14 21:49:11 user nova-compute[73144]: node.session.initial_login_retry_max = 8
Aug 14 21:49:11 user nova-compute[73144]: node.session.xmit_thread_priority = -20
Aug 14 21:49:11 user nova-compute[73144]: node.session.cmds_max = 128
Aug 14 21:49:11 user nova-compute[73144]: node.session.queue_depth = 32
Aug 14 21:49:11 user nova-compute[73144]: node.session.nr_sessions = 1
Aug 14 21:49:11 user nova-compute[73144]: node.session.auth.authmethod = CHAP
Aug 14 21:49:11 user nova-compute[73144]: node.session.auth.username = mCrOxIuM
Aug 14 21:49:11 user nova-compute[73144]: node.session.auth.password = ***
Aug 14 21:49:11 user nova-compute[73144]: node.session.auth.username_in = <empty>
Aug 14 21:49:11 user nova-compute[73144]: node.session.auth.password_in = <empty>
Aug 14 21:49:11 user nova-compute[73144]: node.session.auth.chap_algs = MD5
Aug 14 21:49:11 user nova-compute[73144]: node.session.timeo.replacement_timeout = 120
Aug 14 21:49:11 user nova-compute[73144]: node.session.err_timeo.abort_timeout = 15
Aug 14 21:49:11 user nova-compute[73144]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 21:49:11 user nova-compute[73144]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 21:49:11 user nova-compute[73144]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.FastAbort = Yes
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.InitialR2T = No
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.ImmediateData = Yes
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.MaxConnections = 1
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 21:49:11 user nova-compute[73144]: node.session.iscsi.ERL = 0
Aug 14 21:49:11 user nova-compute[73144]: node.session.scan = manual
Aug 14 21:49:11 user nova-compute[73144]: node.session.reopen_max = 0
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].address = 172.16.0.220
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].port = 3260
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].startup = manual
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].tcp.window_size = 524288
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].tcp.type_of_service = 0
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].timeo.logout_timeout = 15
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].timeo.login_timeout = 15
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].timeo.auth_timeout = 45
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].iscsi.DataDigest = None
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].iscsi.IFMarker = No
Aug 14 21:49:11 user nova-compute[73144]: node.conn[0].iscsi.OFMarker = No
Aug 14 21:49:11 user nova-compute[73144]: # END RECORD
Aug 14 21:49:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:49:11 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:49:11 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:49:11 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:49:11 user nova-compute[73144]:   <serial>3e42c18f-690a-4fd0-a365-b8e7bbbf4329</serial>
Aug 14 21:49:11 user nova-compute[73144]: </disk>
Aug 14 21:49:11 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde2430c-8d2f-460a-9f23-c7ca722152b8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6160f54c-842b-4bfe-9177-11d789459787]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCrOxIuM {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCrOxIuM" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ffff94-369c-40a0-891e-e2cb308d63fe]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCrOxIuM'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cce8ec-ecd9-4265-9811-84aa8670a045]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3151c9c3-8b97-4b40-88c6-223b7a826247]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b9f3b0-fb79-4aac-96ec-c59c5e75b6d7]: (4, ('0 0 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCrOxIuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] <== connect_volume: return (477ms) {'type': 'block', 'scsi_wwn': '26136306362366133', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136306362366133', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-914541680',display_name='tempest-ServerStableDeviceRescueTest-server-914541680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-914541680',id=3,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvqPD1XevevnipezL0SjTUgZvZ3XCWMcpzIT8W1Hz8KROs2Dej1ChQ3ovfHHgZSHgPR+Q79GjA2RDLnkzpqH66uQu+6OSrmRkc4iMBUpC+s/Bq8BLmXbNVtz9y6R7CGKQ==',key_name='tempest-keypair-1696462956',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f55f90fe0860498a85da04d2cb3ae6e4',ramdisk_id='',reservation_id='r-rso97t23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-744721021',owner_user_name='tempest-ServerStableDeviceRescueTest-744721021-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea6e7a8eb644f9eb8974663217a3a98',uuid=ae3ee52c-0811-4c67-a43e-736e02c5511d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "vif_mac": "fa:16:3e:31:42:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converting VIF {"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "vif_mac": "fa:16:3e:31:42:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'pci_devices' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:49:11 user nova-compute[73144]:   <uuid>ae3ee52c-0811-4c67-a43e-736e02c5511d</uuid>
Aug 14 21:49:11 user nova-compute[73144]:   <name>instance-00000003</name>
Aug 14 21:49:11 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:49:11 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:49:11 user nova-compute[73144]:   <metadata>
Aug 14 21:49:11 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:49:11 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:49:11 user nova-compute[73144]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-914541680</nova:name>
Aug 14 21:49:11 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:49:10</nova:creationTime>
Aug 14 21:49:11 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:49:11 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:49:11 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:49:11 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:49:11 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:49:11 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:49:11 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:49:11 user nova-compute[73144]:       <nova:owner>
Aug 14 21:49:11 user nova-compute[73144]:         <nova:user uuid="fea6e7a8eb644f9eb8974663217a3a98">tempest-ServerStableDeviceRescueTest-744721021-project-member</nova:user>
Aug 14 21:49:11 user nova-compute[73144]:         <nova:project uuid="f55f90fe0860498a85da04d2cb3ae6e4">tempest-ServerStableDeviceRescueTest-744721021</nova:project>
Aug 14 21:49:11 user nova-compute[73144]:       </nova:owner>
Aug 14 21:49:11 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:49:11 user nova-compute[73144]:       <nova:ports>
Aug 14 21:49:11 user nova-compute[73144]:         <nova:port uuid="3637b061-93ae-454c-88ff-45478c8bdcda">
Aug 14 21:49:11 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:49:11 user nova-compute[73144]:         </nova:port>
Aug 14 21:49:11 user nova-compute[73144]:       </nova:ports>
Aug 14 21:49:11 user nova-compute[73144]:     </nova:instance>
Aug 14 21:49:11 user nova-compute[73144]:   </metadata>
Aug 14 21:49:11 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:49:11 user nova-compute[73144]:     <system>
Aug 14 21:49:11 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:49:11 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:49:11 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:49:11 user nova-compute[73144]:       <entry name="serial">ae3ee52c-0811-4c67-a43e-736e02c5511d</entry>
Aug 14 21:49:11 user nova-compute[73144]:       <entry name="uuid">ae3ee52c-0811-4c67-a43e-736e02c5511d</entry>
Aug 14 21:49:11 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:49:11 user nova-compute[73144]:     </system>
Aug 14 21:49:11 user nova-compute[73144]:   </sysinfo>
Aug 14 21:49:11 user nova-compute[73144]:   <os>
Aug 14 21:49:11 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:49:11 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:49:11 user nova-compute[73144]:   </os>
Aug 14 21:49:11 user nova-compute[73144]:   <features>
Aug 14 21:49:11 user nova-compute[73144]:     <acpi/>
Aug 14 21:49:11 user nova-compute[73144]:     <apic/>
Aug 14 21:49:11 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:49:11 user nova-compute[73144]:   </features>
Aug 14 21:49:11 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:49:11 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:49:11 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:49:11 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:49:11 user nova-compute[73144]:   </clock>
Aug 14 21:49:11 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:49:11 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:49:11 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:49:11 user nova-compute[73144]:   </cpu>
Aug 14 21:49:11 user nova-compute[73144]:   <devices>
Aug 14 21:49:11 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:49:11 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:49:11 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk"/>
Aug 14 21:49:11 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:49:11 user nova-compute[73144]:     </disk>
Aug 14 21:49:11 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:49:11 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:49:11 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 21:49:11 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:49:11 user nova-compute[73144]:       <serial>5a5bdd80-3b54-4849-9e4a-f1bbf3fff676</serial>
Aug 14 21:49:11 user nova-compute[73144]:     </disk>
Aug 14 21:49:11 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:49:11 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:49:11 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.rescue"/>
Aug 14 21:49:11 user nova-compute[73144]:       <target dev="vdc" bus="virtio"/>
Aug 14 21:49:11 user nova-compute[73144]:       <boot order="1"/>
Aug 14 21:49:11 user nova-compute[73144]:     </disk>
Aug 14 21:49:11 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:49:11 user nova-compute[73144]:       <mac address="fa:16:3e:31:42:f6"/>
Aug 14 21:49:11 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:11 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:49:11 user nova-compute[73144]:       <target dev="tap3637b061-93"/>
Aug 14 21:49:11 user nova-compute[73144]:     </interface>
Aug 14 21:49:11 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:49:11 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/console.log" append="off"/>
Aug 14 21:49:11 user nova-compute[73144]:     </serial>
Aug 14 21:49:11 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:49:11 user nova-compute[73144]:     <video>
Aug 14 21:49:11 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:11 user nova-compute[73144]:     </video>
Aug 14 21:49:11 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:49:11 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:49:11 user nova-compute[73144]:     </rng>
Aug 14 21:49:11 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:49:11 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:49:11 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:49:11 user nova-compute[73144]:     </memballoon>
Aug 14 21:49:11 user nova-compute[73144]:   </devices>
Aug 14 21:49:11 user nova-compute[73144]: </domain>
Aug 14 21:49:11 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:49:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance destroyed successfully.
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] No VIF found with MAC fa:16:3e:31:42:f6, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No VIF found with MAC fa:16:3e:74:a7:97, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:49:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0293033-3d46-43fb-915d-54dfab15e525 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.991s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-ee83b1f2-caa4-4885-805a-d7940d16d7c3 req-04787c88-fc84-478e-869e-5b65e0518505 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ee83b1f2-caa4-4885-805a-d7940d16d7c3 req-04787c88-fc84-478e-869e-5b65e0518505 service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ee83b1f2-caa4-4885-805a-d7940d16d7c3 req-04787c88-fc84-478e-869e-5b65e0518505 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ee83b1f2-caa4-4885-805a-d7940d16d7c3 req-04787c88-fc84-478e-869e-5b65e0518505 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-ee83b1f2-caa4-4885-805a-d7940d16d7c3 req-04787c88-fc84-478e-869e-5b65e0518505 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:13 user nova-compute[73144]: WARNING nova.compute.manager [req-ee83b1f2-caa4-4885-805a-d7940d16d7c3 req-04787c88-fc84-478e-869e-5b65e0518505 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state active and task_state rescuing.
Aug 14 21:49:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-changed-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Refreshing instance network info cache due to event network-changed-61bec669-dace-4e1e-953b-002031bd6e32. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] Acquiring lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] Acquired lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Refreshing network info cache for port 61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Updated VIF entry in instance network info cache for port 61bec669-dace-4e1e-953b-002031bd6e32. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Updating instance_info_cache with network_info: [{"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:14 user nova-compute[73144]: INFO nova.compute.manager [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Terminating instance
Aug 14 21:49:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:49:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c9962727-810b-4c98-9304-9e0959dc74a1 req-4f998ada-b6b2-4974-b936-560655f8e111 service nova] Releasing lock "refresh_cache-afa91ef0-a3e6-40aa-8629-2db440e4d7d2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Stashing vm_state: active {{(pid=73144) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'pci_requests' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.compute.claims [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Claim successful on node user
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'resources' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'pci_devices' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.compute.resource_tracker [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating resource usage from migration 1ef8505c-55bf-400b-8199-237c8494fa58
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-110fd637-fc21-4799-9736-ab14e899a9f9 req-c5568301-321e-470e-9a15-e41f73af8bb3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-vif-unplugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-110fd637-fc21-4799-9736-ab14e899a9f9 req-c5568301-321e-470e-9a15-e41f73af8bb3 service nova] Acquiring lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-110fd637-fc21-4799-9736-ab14e899a9f9 req-c5568301-321e-470e-9a15-e41f73af8bb3 service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-110fd637-fc21-4799-9736-ab14e899a9f9 req-c5568301-321e-470e-9a15-e41f73af8bb3 service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-110fd637-fc21-4799-9736-ab14e899a9f9 req-c5568301-321e-470e-9a15-e41f73af8bb3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] No waiting events found dispatching network-vif-unplugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-110fd637-fc21-4799-9736-ab14e899a9f9 req-c5568301-321e-470e-9a15-e41f73af8bb3 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-vif-unplugged-61bec669-dace-4e1e-953b-002031bd6e32 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Instance destroyed successfully.
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'resources' on Instance uuid afa91ef0-a3e6-40aa-8629-2db440e4d7d2 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-930496660',display_name='tempest-AttachVolumeNegativeTest-server-930496660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-930496660',id=12,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs+e0vNr9zFZdrQyqaFQQgssTvFCAwymRltCoc/LO6jWAOqFindxkfDuY5F6E851UkO8ShAgOQEHiaUVcFbRNHSOIxSe+5icrcu3HZHrTflHeut0RlRkZ+W+bxOejnbOQ==',key_name='tempest-keypair-1720307920',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-xlbcxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=afa91ef0-a3e6-40aa-8629-2db440e4d7d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "61bec669-dace-4e1e-953b-002031bd6e32", "address": "fa:16:3e:48:01:b9", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bec669-da", "ovs_interfaceid": "61bec669-dace-4e1e-953b-002031bd6e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:01:b9,bridge_name='br-int',has_traffic_filtering=True,id=61bec669-dace-4e1e-953b-002031bd6e32,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bec669-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG os_vif [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:01:b9,bridge_name='br-int',has_traffic_filtering=True,id=61bec669-dace-4e1e-953b-002031bd6e32,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bec669-da') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61bec669-da, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: INFO os_vif [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:01:b9,bridge_name='br-int',has_traffic_filtering=True,id=61bec669-dace-4e1e-953b-002031bd6e32,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bec669-da')
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Deleting instance files /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2_del
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Deletion of /opt/stack/data/nova/instances/afa91ef0-a3e6-40aa-8629-2db440e4d7d2_del complete
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-eb8b7609-a25c-4f1b-883b-991344f53a3a req-de7d6b54-c11b-4782-8236-7782bb59e2ad service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eb8b7609-a25c-4f1b-883b-991344f53a3a req-de7d6b54-c11b-4782-8236-7782bb59e2ad service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eb8b7609-a25c-4f1b-883b-991344f53a3a req-de7d6b54-c11b-4782-8236-7782bb59e2ad service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eb8b7609-a25c-4f1b-883b-991344f53a3a req-de7d6b54-c11b-4782-8236-7782bb59e2ad service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-eb8b7609-a25c-4f1b-883b-991344f53a3a req-de7d6b54-c11b-4782-8236-7782bb59e2ad service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:15 user nova-compute[73144]: WARNING nova.compute.manager [req-eb8b7609-a25c-4f1b-883b-991344f53a3a req-de7d6b54-c11b-4782-8236-7782bb59e2ad service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state active and task_state rescuing.
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.compute.manager [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.668s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.compute.manager [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Migrating
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.compute.rpcapi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for ae3ee52c-0811-4c67-a43e-736e02c5511d due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049755.8849962, ae3ee52c-0811-4c67-a43e-736e02c5511d => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] VM Resumed (Lifecycle Event)
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b0c840a1-42b4-4003-a44b-7a215d0d5821 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:15 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 21:49:15 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049755.8853047, ae3ee52c-0811-4c67-a43e-736e02c5511d => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:16 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] VM Started (Lifecycle Event)
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:16 user nova-compute[73144]: INFO nova.compute.manager [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Terminating instance
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f6bdbcd-259c-41f5-807a-f3f5f330ebc9 req-5f3b8e52-6ee2-4301-8d74-5e18adfd8687 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-vif-deleted-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:16 user nova-compute[73144]: INFO nova.compute.manager [req-3f6bdbcd-259c-41f5-807a-f3f5f330ebc9 req-5f3b8e52-6ee2-4301-8d74-5e18adfd8687 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Neutron deleted interface 61bec669-dace-4e1e-953b-002031bd6e32; detaching it from the instance and deleting it from the info cache
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-3f6bdbcd-259c-41f5-807a-f3f5f330ebc9 req-5f3b8e52-6ee2-4301-8d74-5e18adfd8687 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:16 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Took 1.08 seconds to deallocate network for instance.
Aug 14 21:49:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f6bdbcd-259c-41f5-807a-f3f5f330ebc9 req-5f3b8e52-6ee2-4301-8d74-5e18adfd8687 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Detach interface failed, port_id=61bec669-dace-4e1e-953b-002031bd6e32, reason: Instance afa91ef0-a3e6-40aa-8629-2db440e4d7d2 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:49:17 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Instance destroyed successfully.
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lazy-loading 'resources' on Instance uuid 97bb9730-6643-4fa6-be15-05c6f920b2db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-147715936',display_name='tempest-TestVolumeSwap-server-147715936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-147715936',id=9,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhjm3SZh4W9vTa5BY+dRz7S7VY0336FseML/QOH74MZIYnJoW4Q/5SQuQOrMSDY+dZP4VmNYar5lC4vXn6EYVldUH2gcfbSGkFabNkMkAyCDjDrwMjxxcWEYsRZ6aSQCA==',key_name='tempest-keypair-618409022',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b0371933d14425d94c4b4128befd645',ramdisk_id='',reservation_id='r-re6fec1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1557453863',owner_user_name='tempest-TestVolumeSwap-1557453863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758cb24fe4344f67afa1a67f6d4c0207',uuid=97bb9730-6643-4fa6-be15-05c6f920b2db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Converting VIF {"id": "e1162aba-89af-461b-bd63-7c862dfd9095", "address": "fa:16:3e:a9:cf:1a", "network": {"id": "0da3f902-04a3-4384-b718-7f476ce56db7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1550558481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0371933d14425d94c4b4128befd645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1162aba-89", "ovs_interfaceid": "e1162aba-89af-461b-bd63-7c862dfd9095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:cf:1a,bridge_name='br-int',has_traffic_filtering=True,id=e1162aba-89af-461b-bd63-7c862dfd9095,network=Network(0da3f902-04a3-4384-b718-7f476ce56db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1162aba-89') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG os_vif [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:cf:1a,bridge_name='br-int',has_traffic_filtering=True,id=e1162aba-89af-461b-bd63-7c862dfd9095,network=Network(0da3f902-04a3-4384-b718-7f476ce56db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1162aba-89') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1162aba-89, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:17 user nova-compute[73144]: INFO os_vif [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:cf:1a,bridge_name='br-int',has_traffic_filtering=True,id=e1162aba-89af-461b-bd63-7c862dfd9095,network=Network(0da3f902-04a3-4384-b718-7f476ce56db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1162aba-89')
Aug 14 21:49:17 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Deleting instance files /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db_del
Aug 14 21:49:17 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Deletion of /opt/stack/data/nova/instances/97bb9730-6643-4fa6-be15-05c6f920b2db_del complete
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:17 user nova-compute[73144]: INFO nova.compute.manager [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Starting migrate_disk_and_power_off {{(pid=73144) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received event network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Acquiring lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] No waiting events found dispatching network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:17 user nova-compute[73144]: WARNING nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Received unexpected event network-vif-plugged-61bec669-dace-4e1e-953b-002031bd6e32 for instance with vm_state deleted and task_state None.
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-vif-unplugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] No waiting events found dispatching network-vif-unplugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-vif-unplugged-e1162aba-89af-461b-bd63-7c862dfd9095 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Acquiring lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] No waiting events found dispatching network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:17 user nova-compute[73144]: WARNING nova.compute.manager [req-fea7df39-8c0d-4b40-93b9-d15c2e517845 req-d91004f9-33f3-4a55-b7be-45fb1a9488d4 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received unexpected event network-vif-plugged-e1162aba-89af-461b-bd63-7c862dfd9095 for instance with vm_state active and task_state deleting.
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.640s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:17 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Deleted allocations for instance afa91ef0-a3e6-40aa-8629-2db440e4d7d2
Aug 14 21:49:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-20b23c92-3477-48a1-a54c-1c640392c56a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "afa91ef0-a3e6-40aa-8629-2db440e4d7d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.975s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance destroyed successfully.
Aug 14 21:49:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-476370894-network", "vif_mac": "fa:16:3e:74:a7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-476370894-network", "vif_mac": "fa:16:3e:74:a7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_vif [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap758cbe79-b4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:18 user nova-compute[73144]: INFO os_vif [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4')
Aug 14 21:49:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:18 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddfb11f-2104-4c2f-a15e-ab3e1dd8eb90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a40b1ca-3de5-42fc-9f5e-99cec242cebc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586aa0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de313ca-40a0-4339-a667-79ca01e8f4d2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600889a-d20c-4526-a1e8-b7402dbb9a38]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639964d-f9b1-4ee8-908c-89b61f8dd0fa]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Took 1.29 seconds to deallocate network for instance.
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f7326d-08aa-4ca7-932c-25fdec64af29]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[823ba5f0-60fd-4c61-adb3-dba0a10dc0d9]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a138ea-88eb-4d5d-8304-3a46aa3a4f4d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]
Aug 14 21:49:18 user nova-compute[73144]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.
Aug 14 21:49:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e1b3b-5ec0-4da3-8b60-311b2ecc57dc]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== disconnect_volume: return (404ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-unplugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-unplugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:19 user nova-compute[73144]: WARNING nova.compute.manager [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-unplugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state active and task_state resize_migrating.
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:19 user nova-compute[73144]: WARNING nova.compute.manager [req-0fd14c2b-e9d9-4ceb-94c8-02b42b0e42b2 req-51b7ed17-9c99-4b7c-a72f-3f1d8fd77df7 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state active and task_state resize_migrating.
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.592s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:19 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Deleted allocations for instance 97bb9730-6643-4fa6-be15-05c6f920b2db
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0_resize/disk /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c7a5a13b-9834-455b-84ca-26c5819b40eb tempest-TestVolumeSwap-1557453863 tempest-TestVolumeSwap-1557453863-project-member] Lock "97bb9730-6643-4fa6-be15-05c6f920b2db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.282s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-34cbaf74-455e-4c2b-bd60-8badce40dd13 req-ca82a3e3-30fd-44f8-98de-0e8a2e2486e4 service nova] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Received event network-vif-deleted-e1162aba-89af-461b-bd63-7c862dfd9095 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "cp -r /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0_resize/disk /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk" returned: 0 in 0.543s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0_resize/disk.info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk.info {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "cp -r /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0_resize/disk.info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk.info" returned: 0 in 0.034s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Port 758cbe79-b4b9-40b7-93a4-37b07664efb4 binding to destination host user is already ACTIVE {{(pid=73144) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquired lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'info_cache' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.utils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ba9b38-79ee-482e-b01f-70b0b15c85a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[823f13f5-d77e-482c-ab5f-0ce4534fe356]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7136e2e2-439d-48e4-bd8b-7a106e3f8a4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad14931-be97-4b47-9bb4-ea87606965df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:49:22 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9f31bb-eb7a-4613-b664-438eaefe7fd0]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.utils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Releasing lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:49:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance destroyed successfully.
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'resources' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_vif [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap405993c1-92, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:22 user nova-compute[73144]: INFO os_vif [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92')
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCjNgyrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:22 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c1c05-53f8-4eb9-a14b-44e708e001c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc461a8d-7a14-4329-bd35-c297671e2c67]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1787a3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'): ({'sdg'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Removing single pathed devices sdg {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cefb22-b977-41fa-968d-30b2c73f8cac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[78394307-5667-4221-9494-96821f53970f]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flushing IO for device /dev/sdg {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[11336ff3-7f87-4492-9b06-72833dc1050c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14e3793-7b1e-42dc-909d-5b2f5c61fc39]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] SCSI volumes sdg have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[845b3947-f152-4ac8-b5d1-6dc64d51eeb0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b55daf-7350-4838-8556-628ded800811]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]
Aug 14 21:49:22 user nova-compute[73144]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.
Aug 14 21:49:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b80982d-2779-4b1e-8f7d-adac7d02c26a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== disconnect_volume: return (297ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Start _get_guest_xml network_info=[{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'efaeae9d-f61f-46c6-8b9a-e562167a7808', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCjNgyrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5fb72bd6-7deb-4a48-b1ef-410911faec15', 'attached_at': '', 'detached_at': '', 'volume_id': '3d78c19b-023d-485d-a2d5-7a7ca3f7fde0', 'serial': '3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:22 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:22 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCjNgyrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:22 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:22 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:22 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f65d865-50b7-499d-bc56-dc86625dd329]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:49:22 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4697fe6-a40e-4c9a-bab8-472eba720283]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0] added
Aug 14 21:49:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be6a37c-1194-4803-8856-87c0e37eb7d8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52519b2-82d2-497e-9568-3ca5f07ffe23]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCjNgyrv {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCjNgyrv" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca29eeb-0027-4ab2-b6d3-380d721270c5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DCjNgyrv'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3efe30d-7dd1-4ad4-bb1d-e60cd6367f97]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70be077-fadb-4494-a7c9-cf8a82fcb4af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d4422-2ebb-451f-8727-a656b93e8206]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]
Aug 14 21:49:22 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.
Aug 14 21:49:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a558f9ef-dc51-491c-ab77-2525980f98b2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea346840-1528-48f9-969b-93d5fe2a24f6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:23 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:23 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:23 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:23 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d5ce6-fc18-4427-8366-99037c67f2c2]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:49:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCjNgyrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23065333366353466', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065333366353466', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:49:24 user nova-compute[73144]:   <uuid>5fb72bd6-7deb-4a48-b1ef-410911faec15</uuid>
Aug 14 21:49:24 user nova-compute[73144]:   <name>instance-00000004</name>
Aug 14 21:49:24 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:49:24 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:49:24 user nova-compute[73144]:   <metadata>
Aug 14 21:49:24 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:49:24 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:49:24 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeTestJSON-server-1723144730</nova:name>
Aug 14 21:49:24 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:49:22</nova:creationTime>
Aug 14 21:49:24 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:49:24 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:49:24 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:49:24 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:49:24 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:49:24 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:49:24 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:49:24 user nova-compute[73144]:       <nova:owner>
Aug 14 21:49:24 user nova-compute[73144]:         <nova:user uuid="89f3461a4f8f45e584180e2b18d782b0">tempest-AttachVolumeTestJSON-881893264-project-member</nova:user>
Aug 14 21:49:24 user nova-compute[73144]:         <nova:project uuid="3842f55070374c288d0e1500d297485e">tempest-AttachVolumeTestJSON-881893264</nova:project>
Aug 14 21:49:24 user nova-compute[73144]:       </nova:owner>
Aug 14 21:49:24 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:49:24 user nova-compute[73144]:       <nova:ports>
Aug 14 21:49:24 user nova-compute[73144]:         <nova:port uuid="405993c1-92ac-4e9f-b75c-44deb4a9f3dd">
Aug 14 21:49:24 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 21:49:24 user nova-compute[73144]:         </nova:port>
Aug 14 21:49:24 user nova-compute[73144]:       </nova:ports>
Aug 14 21:49:24 user nova-compute[73144]:     </nova:instance>
Aug 14 21:49:24 user nova-compute[73144]:   </metadata>
Aug 14 21:49:24 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:49:24 user nova-compute[73144]:     <system>
Aug 14 21:49:24 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:49:24 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:49:24 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:49:24 user nova-compute[73144]:       <entry name="serial">5fb72bd6-7deb-4a48-b1ef-410911faec15</entry>
Aug 14 21:49:24 user nova-compute[73144]:       <entry name="uuid">5fb72bd6-7deb-4a48-b1ef-410911faec15</entry>
Aug 14 21:49:24 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:49:24 user nova-compute[73144]:     </system>
Aug 14 21:49:24 user nova-compute[73144]:   </sysinfo>
Aug 14 21:49:24 user nova-compute[73144]:   <os>
Aug 14 21:49:24 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:49:24 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:49:24 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:49:24 user nova-compute[73144]:   </os>
Aug 14 21:49:24 user nova-compute[73144]:   <features>
Aug 14 21:49:24 user nova-compute[73144]:     <acpi/>
Aug 14 21:49:24 user nova-compute[73144]:     <apic/>
Aug 14 21:49:24 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:49:24 user nova-compute[73144]:   </features>
Aug 14 21:49:24 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:49:24 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:49:24 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:49:24 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:49:24 user nova-compute[73144]:   </clock>
Aug 14 21:49:24 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:49:24 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:49:24 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:49:24 user nova-compute[73144]:   </cpu>
Aug 14 21:49:24 user nova-compute[73144]:   <devices>
Aug 14 21:49:24 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:49:24 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:49:24 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk"/>
Aug 14 21:49:24 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:49:24 user nova-compute[73144]:     </disk>
Aug 14 21:49:24 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:49:24 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:49:24 user nova-compute[73144]:       <source dev="/dev/sdc"/>
Aug 14 21:49:24 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:49:24 user nova-compute[73144]:       <serial>3d78c19b-023d-485d-a2d5-7a7ca3f7fde0</serial>
Aug 14 21:49:24 user nova-compute[73144]:     </disk>
Aug 14 21:49:24 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:49:24 user nova-compute[73144]:       <mac address="fa:16:3e:fb:d3:d3"/>
Aug 14 21:49:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:24 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:49:24 user nova-compute[73144]:       <target dev="tap405993c1-92"/>
Aug 14 21:49:24 user nova-compute[73144]:     </interface>
Aug 14 21:49:24 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:49:24 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/console.log" append="off"/>
Aug 14 21:49:24 user nova-compute[73144]:     </serial>
Aug 14 21:49:24 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:49:24 user nova-compute[73144]:     <video>
Aug 14 21:49:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:24 user nova-compute[73144]:     </video>
Aug 14 21:49:24 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:49:24 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:49:24 user nova-compute[73144]:     </rng>
Aug 14 21:49:24 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:49:24 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:49:24 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:49:24 user nova-compute[73144]:     </memballoon>
Aug 14 21:49:24 user nova-compute[73144]:   </devices>
Aug 14 21:49:24 user nova-compute[73144]: </domain>
Aug 14 21:49:24 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Cannot resize image /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'migration_context' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:47:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG os_vif [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap405993c1-92, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap405993c1-92, col_values=(('external_ids', {'iface-id': '405993c1-92ac-4e9f-b75c-44deb4a9f3dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:d3:d3', 'vm-uuid': '5fb72bd6-7deb-4a48-b1ef-410911faec15'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:25 user nova-compute[73144]: INFO os_vif [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92')
Aug 14 21:49:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-1876dd28-b2bb-457c-8c3c-8b5ebd183c35 req-4280d7fd-3df9-4d4f-96a5-99cb4b8a3db6 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1876dd28-b2bb-457c-8c3c-8b5ebd183c35 req-4280d7fd-3df9-4d4f-96a5-99cb4b8a3db6 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1876dd28-b2bb-457c-8c3c-8b5ebd183c35 req-4280d7fd-3df9-4d4f-96a5-99cb4b8a3db6 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1876dd28-b2bb-457c-8c3c-8b5ebd183c35 req-4280d7fd-3df9-4d4f-96a5-99cb4b8a3db6 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-1876dd28-b2bb-457c-8c3c-8b5ebd183c35 req-4280d7fd-3df9-4d4f-96a5-99cb4b8a3db6 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:26 user nova-compute[73144]: WARNING nova.compute.manager [req-1876dd28-b2bb-457c-8c3c-8b5ebd183c35 req-4280d7fd-3df9-4d4f-96a5-99cb4b8a3db6 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state stopped and task_state powering-on.
Aug 14 21:49:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-aed2a0ac-c0f2-411e-99af-66b0ad8d7593 req-4903ba13-aa6b-480a-9f47-c8102e0e469b service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aed2a0ac-c0f2-411e-99af-66b0ad8d7593 req-4903ba13-aa6b-480a-9f47-c8102e0e469b service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aed2a0ac-c0f2-411e-99af-66b0ad8d7593 req-4903ba13-aa6b-480a-9f47-c8102e0e469b service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aed2a0ac-c0f2-411e-99af-66b0ad8d7593 req-4903ba13-aa6b-480a-9f47-c8102e0e469b service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-aed2a0ac-c0f2-411e-99af-66b0ad8d7593 req-4903ba13-aa6b-480a-9f47-c8102e0e469b service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:28 user nova-compute[73144]: WARNING nova.compute.manager [req-aed2a0ac-c0f2-411e-99af-66b0ad8d7593 req-4903ba13-aa6b-480a-9f47-c8102e0e469b service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state stopped and task_state powering-on.
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049769.2397547, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Resumed (Lifecycle Event)
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance rebooted successfully.
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dd194354-8cdc-4e3c-8861-1e474065fa84 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049769.2478843, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Started (Lifecycle Event)
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:29 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 21:49:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:30 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049755.6560144, afa91ef0-a3e6-40aa-8629-2db440e4d7d2 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:30 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] VM Stopped (Lifecycle Event)
Aug 14 21:49:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9042efc9-852d-4066-8ef8-4b8386d124f1 None None] [instance: afa91ef0-a3e6-40aa-8629-2db440e4d7d2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:31 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049756.9705591, 97bb9730-6643-4fa6-be15-05c6f920b2db => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:31 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] VM Stopped (Lifecycle Event)
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a9a92bd5-1640-4aa7-b579-91729d216694 None None] [instance: 97bb9730-6643-4fa6-be15-05c6f920b2db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Starting finish_migration {{(pid=73144) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 21:49:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Creating image(s)
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'trusted_certs' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.198s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk. size=21474836480 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk 21474836480 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk 21474836480" returned: 0 in 0.057s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Ensure instance console log exists: /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Start _get_guest_xml network_info=[{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-476370894-network", "vif_mac": "fa:16:3e:74:a7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '5755df1a-8651-4f50-b68c-195041bd7989', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'abb6bbee-268b-45c6-b3da-49ecc86944c0', 'attached_at': '2023-08-14T21:49:32.000000', 'detached_at': '', 'volume_id': '3e42c18f-690a-4fd0-a365-b8e7bbbf4329', 'serial': '3e42c18f-690a-4fd0-a365-b8e7bbbf4329'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:49:32 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:32 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'vcpu_model' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:32 user nova-compute[73144]: INFO nova.compute.manager [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Terminating instance
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:49:32 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:32 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:49:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:49:32 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d440a7f7-bb11-4280-884b-881e176fbb62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:49:32 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca765a2e-0e8e-483c-931b-e28a0f59dbb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329] added
Aug 14 21:49:32 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e4758-4706-4538-8b20-03de9228a573]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85800c4-93de-4761-86db-782931d416dc]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTYcpkGm {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTYcpkGm" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28f4c67-3e39-41da-ad41-3980f7803589]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTYcpkGm'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c78b8-2f96-42f1-a122-a3c75c551ddb]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec37ae7-cdeb-469e-a2fe-7ef79d90b0b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c208c-dbab-4e88-b4e2-ffe23187805b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]
Aug 14 21:49:33 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.
Aug 14 21:49:33 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b105ed34-8b95-4579-8f4e-9b3444f25455]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049758.2524433, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:33 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Stopped (Lifecycle Event)
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-37bcf4c0-4c8d-4fe7-9d32-c4423eb02d46 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea91231-b14f-425f-bf4f-107fad3ac365]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:49:33 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-37bcf4c0-4c8d-4fe7-9d32-c4423eb02d46 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3528222b-0982-4421-90ad-2e7b1b0dc9d6]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:49:33 user nova-compute[73144]: INFO nova.compute.manager [None req-37bcf4c0-4c8d-4fe7-9d32-c4423eb02d46 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf02393f-e374-47f1-bb75-ef4d0783b0fb req-8f451e5a-c9f3-40ef-a071-1ce15488603f service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received event network-vif-unplugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf02393f-e374-47f1-bb75-ef4d0783b0fb req-8f451e5a-c9f3-40ef-a071-1ce15488603f service nova] Acquiring lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf02393f-e374-47f1-bb75-ef4d0783b0fb req-8f451e5a-c9f3-40ef-a071-1ce15488603f service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf02393f-e374-47f1-bb75-ef4d0783b0fb req-8f451e5a-c9f3-40ef-a071-1ce15488603f service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf02393f-e374-47f1-bb75-ef4d0783b0fb req-8f451e5a-c9f3-40ef-a071-1ce15488603f service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] No waiting events found dispatching network-vif-unplugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf02393f-e374-47f1-bb75-ef4d0783b0fb req-8f451e5a-c9f3-40ef-a071-1ce15488603f service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received event network-vif-unplugged-f43a757f-377e-4de8-aae8-e0a5f5681010 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:49:33 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Instance destroyed successfully.
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lazy-loading 'resources' on Instance uuid 77326cfd-7f16-4dca-8216-fd42d3a7b50b {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-94990191',display_name='tempest-VolumesActionsTest-instance-94990191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-94990191',id=13,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be14e5de45434b098f04c1542b3fb835',ramdisk_id='',reservation_id='r-510xsj3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-491668790',owner_user_name='tempest-VolumesActionsTest-491668790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:47:48Z,user_data=None,user_id='86a7e438722d4fe2b70c0546c64093d9',uuid=77326cfd-7f16-4dca-8216-fd42d3a7b50b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converting VIF {"id": "f43a757f-377e-4de8-aae8-e0a5f5681010", "address": "fa:16:3e:6a:89:eb", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a757f-37", "ovs_interfaceid": "f43a757f-377e-4de8-aae8-e0a5f5681010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:89:eb,bridge_name='br-int',has_traffic_filtering=True,id=f43a757f-377e-4de8-aae8-e0a5f5681010,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a757f-37') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG os_vif [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:89:eb,bridge_name='br-int',has_traffic_filtering=True,id=f43a757f-377e-4de8-aae8-e0a5f5681010,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a757f-37') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf43a757f-37, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:33 user nova-compute[73144]: INFO os_vif [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:89:eb,bridge_name='br-int',has_traffic_filtering=True,id=f43a757f-377e-4de8-aae8-e0a5f5681010,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a757f-37')
Aug 14 21:49:33 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Deleting instance files /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b_del
Aug 14 21:49:33 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Deletion of /opt/stack/data/nova/instances/77326cfd-7f16-4dca-8216-fd42d3a7b50b_del complete
Aug 14 21:49:33 user nova-compute[73144]: INFO nova.compute.manager [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 14 21:49:33 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:49:33 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26237626263303761', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237626263303761', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:49:34 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Took 0.63 seconds to deallocate network for instance.
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-476370894-network", "vif_mac": "fa:16:3e:74:a7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-476370894-network", "vif_mac": "fa:16:3e:74:a7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:49:34 user nova-compute[73144]:   <uuid>abb6bbee-268b-45c6-b3da-49ecc86944c0</uuid>
Aug 14 21:49:34 user nova-compute[73144]:   <name>instance-00000005</name>
Aug 14 21:49:34 user nova-compute[73144]:   <memory>2097152</memory>
Aug 14 21:49:34 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:49:34 user nova-compute[73144]:   <metadata>
Aug 14 21:49:34 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:49:34 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:49:34 user nova-compute[73144]:       <nova:name>tempest-ServerActionsTestOtherB-server-504781444</nova:name>
Aug 14 21:49:34 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:49:32</nova:creationTime>
Aug 14 21:49:34 user nova-compute[73144]:       <nova:flavor name="m1.small">
Aug 14 21:49:34 user nova-compute[73144]:         <nova:memory>2048</nova:memory>
Aug 14 21:49:34 user nova-compute[73144]:         <nova:disk>20</nova:disk>
Aug 14 21:49:34 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:49:34 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:49:34 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:49:34 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:49:34 user nova-compute[73144]:       <nova:owner>
Aug 14 21:49:34 user nova-compute[73144]:         <nova:user uuid="f24af35347484e5982207ed21f62bc2a">tempest-ServerActionsTestOtherB-679953584-project-member</nova:user>
Aug 14 21:49:34 user nova-compute[73144]:         <nova:project uuid="1c3eaba4f7824769adb0e2a2a28f3924">tempest-ServerActionsTestOtherB-679953584</nova:project>
Aug 14 21:49:34 user nova-compute[73144]:       </nova:owner>
Aug 14 21:49:34 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:49:34 user nova-compute[73144]:       <nova:ports>
Aug 14 21:49:34 user nova-compute[73144]:         <nova:port uuid="758cbe79-b4b9-40b7-93a4-37b07664efb4">
Aug 14 21:49:34 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 21:49:34 user nova-compute[73144]:         </nova:port>
Aug 14 21:49:34 user nova-compute[73144]:       </nova:ports>
Aug 14 21:49:34 user nova-compute[73144]:     </nova:instance>
Aug 14 21:49:34 user nova-compute[73144]:   </metadata>
Aug 14 21:49:34 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:49:34 user nova-compute[73144]:     <system>
Aug 14 21:49:34 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:49:34 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:49:34 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:49:34 user nova-compute[73144]:       <entry name="serial">abb6bbee-268b-45c6-b3da-49ecc86944c0</entry>
Aug 14 21:49:34 user nova-compute[73144]:       <entry name="uuid">abb6bbee-268b-45c6-b3da-49ecc86944c0</entry>
Aug 14 21:49:34 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:49:34 user nova-compute[73144]:     </system>
Aug 14 21:49:34 user nova-compute[73144]:   </sysinfo>
Aug 14 21:49:34 user nova-compute[73144]:   <os>
Aug 14 21:49:34 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:49:34 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:49:34 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:49:34 user nova-compute[73144]:   </os>
Aug 14 21:49:34 user nova-compute[73144]:   <features>
Aug 14 21:49:34 user nova-compute[73144]:     <acpi/>
Aug 14 21:49:34 user nova-compute[73144]:     <apic/>
Aug 14 21:49:34 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:49:34 user nova-compute[73144]:   </features>
Aug 14 21:49:34 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:49:34 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:49:34 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:49:34 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:49:34 user nova-compute[73144]:   </clock>
Aug 14 21:49:34 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:49:34 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:49:34 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:49:34 user nova-compute[73144]:   </cpu>
Aug 14 21:49:34 user nova-compute[73144]:   <devices>
Aug 14 21:49:34 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:49:34 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:49:34 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk"/>
Aug 14 21:49:34 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:49:34 user nova-compute[73144]:     </disk>
Aug 14 21:49:34 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:49:34 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:49:34 user nova-compute[73144]:       <source dev="/dev/sdd"/>
Aug 14 21:49:34 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:49:34 user nova-compute[73144]:       <serial>3e42c18f-690a-4fd0-a365-b8e7bbbf4329</serial>
Aug 14 21:49:34 user nova-compute[73144]:     </disk>
Aug 14 21:49:34 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:49:34 user nova-compute[73144]:       <mac address="fa:16:3e:74:a7:97"/>
Aug 14 21:49:34 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:34 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:49:34 user nova-compute[73144]:       <target dev="tap758cbe79-b4"/>
Aug 14 21:49:34 user nova-compute[73144]:     </interface>
Aug 14 21:49:34 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:49:34 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/console.log" append="off"/>
Aug 14 21:49:34 user nova-compute[73144]:     </serial>
Aug 14 21:49:34 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:49:34 user nova-compute[73144]:     <video>
Aug 14 21:49:34 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:49:34 user nova-compute[73144]:     </video>
Aug 14 21:49:34 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:49:34 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:49:34 user nova-compute[73144]:     </rng>
Aug 14 21:49:34 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:49:34 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:49:34 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:49:34 user nova-compute[73144]:     </memballoon>
Aug 14 21:49:34 user nova-compute[73144]:   </devices>
Aug 14 21:49:34 user nova-compute[73144]: </domain>
Aug 14 21:49:34 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-476370894-network", "vif_mac": "fa:16:3e:74:a7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-476370894-network", "vif_mac": "fa:16:3e:74:a7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG os_vif [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap758cbe79-b4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap758cbe79-b4, col_values=(('external_ids', {'iface-id': '758cbe79-b4b9-40b7-93a4-37b07664efb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:a7:97', 'vm-uuid': 'abb6bbee-268b-45c6-b3da-49ecc86944c0'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:34 user nova-compute[73144]: INFO os_vif [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4')
Aug 14 21:49:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] No VIF found with MAC fa:16:3e:74:a7:97, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:49:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:34 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Deleted allocations for instance 77326cfd-7f16-4dca-8216-fd42d3a7b50b
Aug 14 21:49:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b3e57e36-f468-45a5-bd7a-afba2153e7f6 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-ca48c640-90f1-420b-93f0-63491f76c52c req-ea966fc2-1226-455f-a514-2efcfdf60d82 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received event network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ca48c640-90f1-420b-93f0-63491f76c52c req-ea966fc2-1226-455f-a514-2efcfdf60d82 service nova] Acquiring lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ca48c640-90f1-420b-93f0-63491f76c52c req-ea966fc2-1226-455f-a514-2efcfdf60d82 service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ca48c640-90f1-420b-93f0-63491f76c52c req-ea966fc2-1226-455f-a514-2efcfdf60d82 service nova] Lock "77326cfd-7f16-4dca-8216-fd42d3a7b50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-ca48c640-90f1-420b-93f0-63491f76c52c req-ea966fc2-1226-455f-a514-2efcfdf60d82 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] No waiting events found dispatching network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:35 user nova-compute[73144]: WARNING nova.compute.manager [req-ca48c640-90f1-420b-93f0-63491f76c52c req-ea966fc2-1226-455f-a514-2efcfdf60d82 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received unexpected event network-vif-plugged-f43a757f-377e-4de8-aae8-e0a5f5681010 for instance with vm_state deleted and task_state None.
Aug 14 21:49:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-ca48c640-90f1-420b-93f0-63491f76c52c req-ea966fc2-1226-455f-a514-2efcfdf60d82 service nova] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Received event network-vif-deleted-f43a757f-377e-4de8-aae8-e0a5f5681010 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:37 user nova-compute[73144]: WARNING nova.compute.manager [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state active and task_state resize_finish.
Aug 14 21:49:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:49:37 user nova-compute[73144]: WARNING nova.compute.manager [req-6b177f6a-c0a5-4a70-9699-ed6b8edea6ee req-cec35a8e-7ff6-4d6c-8023-e08210769371 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state active and task_state resize_finish.
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049778.296504, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Resumed (Lifecycle Event)
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:49:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance running successfully.
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Failed to set time: agent not configured {{(pid=73144) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0a5a1c3e-4ef3-42f0-abd5-f9514fb31cfe tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] finish_migration finished successfully. {{(pid=73144) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049778.2967594, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Started (Lifecycle Event)
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:49:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 21:49:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:48 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049773.5693674, 77326cfd-7f16-4dca-8216-fd42d3a7b50b => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:49:48 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] VM Stopped (Lifecycle Event)
Aug 14 21:49:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ca87805e-8e3b-4a82-b18a-f5ebd8770ddf None None] [instance: 77326cfd-7f16-4dca-8216-fd42d3a7b50b] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:49:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:52 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:49:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:49:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:49:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7390MB free_disk=25.429096221923828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Applying migration context for instance abb6bbee-268b-45c6-b3da-49ecc86944c0 as it has an incoming, in-progress migration 1ef8505c-55bf-400b-8199-237c8494fa58. Migration status is finished {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 21:50:02 user nova-compute[73144]: INFO nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating resource usage from migration 1ef8505c-55bf-400b-8199-237c8494fa58
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ae3ee52c-0811-4c67-a43e-736e02c5511d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4583cc14-41a8-46b7-85d5-440efba5ec4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ea802951-a15c-4dac-a693-4fe96ef3cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Migration 1ef8505c-55bf-400b-8199-237c8494fa58 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:50:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:07 user nova-compute[73144]: INFO nova.compute.manager [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Detaching volume bbc40de8-a398-4f35-bff3-8a4c80626d21
Aug 14 21:50:07 user nova-compute[73144]: INFO nova.virt.block_device [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Attempting to driver detach volume bbc40de8-a398-4f35-bff3-8a4c80626d21 from mountpoint /dev/vdb
Aug 14 21:50:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Attempting to detach device vdb from instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:50:07 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:50:07 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:50:07 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:50:07 user nova-compute[73144]:   <serial>bbc40de8-a398-4f35-bff3-8a4c80626d21</serial>
Aug 14 21:50:07 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:50:07 user nova-compute[73144]: </disk>
Aug 14 21:50:07 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:50:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully detached device vdb from instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 from the persistent domain config.
Aug 14 21:50:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:50:07 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:50:07 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:50:07 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:50:07 user nova-compute[73144]:   <serial>bbc40de8-a398-4f35-bff3-8a4c80626d21</serial>
Aug 14 21:50:07 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:50:07 user nova-compute[73144]: </disk>
Aug 14 21:50:07 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049807.7885637, c16f9e34-3fc2-49c7-b0b8-99c5e5153818 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:50:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully detached device vdb from instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818 from the live domain config.
Aug 14 21:50:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzXraIWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:50:07 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce058b79-3565-48aa-9b82-519dad66f90d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90b4f9-11bb-4b59-8816-26e1e9adca95]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 (non-flash)
Aug 14 21:50:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586c1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c77330-6bdb-4313-91f5-5de11418aa41]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.049s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7d7d3f-4241-4a0a-bb1a-6da96360d7be]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607baee-5372-49c4-beeb-79572300248b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:50:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.070s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5520c8-3ebe-4dd0-ab4b-0d0efde30207]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa393cb-03b9-4d76-8d6c-de015ef65e54]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c6893d-847a-4a50-ad27-cb61c60bf34c]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260]
Aug 14 21:50:08 user nova-compute[73144]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21, portal: 172.16.0.220,3260] successful.
Aug 14 21:50:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc40de8-a398-4f35-bff3-8a4c80626d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd40468-3fcc-4f13-ab20-d6de1e3be962]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== disconnect_volume: return (394ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:50:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:50:09 user nova-compute[73144]: INFO nova.compute.claims [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Claim successful on node user
Aug 14 21:50:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:50:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 21:50:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:50:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Creating image(s)
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "/opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "/opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "5601f5b4019f7bdbbe50f23ab6eb37e8f091b193" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "5601f5b4019f7bdbbe50f23ab6eb37e8f091b193" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG nova.policy [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23bddedc457f4297967d717f946eb1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bf7988794545408e34d6cb24337601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG nova.virt.images [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] e196d1f1-d962-47f6-bafb-c464cb219da7 was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.part /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.part /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.converted" returned: 0 in 0.147s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "5601f5b4019f7bdbbe50f23ab6eb37e8f091b193" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.974s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193 --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "5601f5b4019f7bdbbe50f23ab6eb37e8f091b193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "5601f5b4019f7bdbbe50f23ab6eb37e8f091b193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193 --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193,backing_fmt=raw /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193,backing_fmt=raw /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk 1073741824" returned: 0 in 0.052s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "5601f5b4019f7bdbbe50f23ab6eb37e8f091b193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193 --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Successfully created port: db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Cannot resize image /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lazy-loading 'migration_context' on Instance uuid bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Ensure instance console log exists: /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Successfully updated port: db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquired lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-changed-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Refreshing instance network info cache due to event network-changed-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] Acquiring lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updating instance_info_cache with network_info: [{"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Releasing lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Instance network_info: |[{"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] Acquired lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Refreshing network info cache for port db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Start _get_guest_xml network_info=[{"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:50:01Z,direct_url=<?>,disk_format='qcow2',id=e196d1f1-d962-47f6-bafb-c464cb219da7,min_disk=0,min_ram=0,name='',owner='12db8538eea64e4fbd100ef10e95c3e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:50:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'image_id': 'e196d1f1-d962-47f6-bafb-c464cb219da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:50:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:50:01Z,direct_url=<?>,disk_format='qcow2',id=e196d1f1-d962-47f6-bafb-c464cb219da7,min_disk=0,min_ram=0,name='',owner='12db8538eea64e4fbd100ef10e95c3e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:50:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-375952859',display_name='tempest-AttachSCSIVolumeTestJSON-server-375952859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-375952859',id=16,image_ref='e196d1f1-d962-47f6-bafb-c464cb219da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPfe7ITLT/pSTBgorOr416fX2nVB33f6TYdXgEKdddgE8L8g4tDBy9PJt/euQpMMW+CLEUMECnQVThA71bFadTlmWl4pJlVyAx75J7v9ubk/L3hO5In1f+y2PEEESKChA==',key_name='tempest-keypair-1394412740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67bf7988794545408e34d6cb24337601',ramdisk_id='',reservation_id='r-i0x81985',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e196d1f1-d962-47f6-bafb-c464cb219da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-554340252',owner_user_name='tempest-AttachSCSIVolumeTestJSON-554340252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23bddedc457f4297967d717f946eb1e5',uuid=bd2d7d21-f497-4a08-8c70-946dbc83d9db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Converting VIF {"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:8a,bridge_name='br-int',has_traffic_filtering=True,id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a,network=Network(50fa9030-7d57-4c6c-9735-88f8f1156a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1673eb-0d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lazy-loading 'pci_devices' on Instance uuid bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:50:14 user nova-compute[73144]:   <uuid>bd2d7d21-f497-4a08-8c70-946dbc83d9db</uuid>
Aug 14 21:50:14 user nova-compute[73144]:   <name>instance-00000010</name>
Aug 14 21:50:14 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:50:14 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:50:14 user nova-compute[73144]:   <metadata>
Aug 14 21:50:14 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:50:14 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:50:14 user nova-compute[73144]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-375952859</nova:name>
Aug 14 21:50:14 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:50:14</nova:creationTime>
Aug 14 21:50:14 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:50:14 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:50:14 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:50:14 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:50:14 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:50:14 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:50:14 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:50:14 user nova-compute[73144]:       <nova:owner>
Aug 14 21:50:14 user nova-compute[73144]:         <nova:user uuid="23bddedc457f4297967d717f946eb1e5">tempest-AttachSCSIVolumeTestJSON-554340252-project-member</nova:user>
Aug 14 21:50:14 user nova-compute[73144]:         <nova:project uuid="67bf7988794545408e34d6cb24337601">tempest-AttachSCSIVolumeTestJSON-554340252</nova:project>
Aug 14 21:50:14 user nova-compute[73144]:       </nova:owner>
Aug 14 21:50:14 user nova-compute[73144]:       <nova:root type="image" uuid="e196d1f1-d962-47f6-bafb-c464cb219da7"/>
Aug 14 21:50:14 user nova-compute[73144]:       <nova:ports>
Aug 14 21:50:14 user nova-compute[73144]:         <nova:port uuid="db1673eb-0d2f-4c7d-ab31-2d3b2aac388a">
Aug 14 21:50:14 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 21:50:14 user nova-compute[73144]:         </nova:port>
Aug 14 21:50:14 user nova-compute[73144]:       </nova:ports>
Aug 14 21:50:14 user nova-compute[73144]:     </nova:instance>
Aug 14 21:50:14 user nova-compute[73144]:   </metadata>
Aug 14 21:50:14 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:50:14 user nova-compute[73144]:     <system>
Aug 14 21:50:14 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:50:14 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:50:14 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:50:14 user nova-compute[73144]:       <entry name="serial">bd2d7d21-f497-4a08-8c70-946dbc83d9db</entry>
Aug 14 21:50:14 user nova-compute[73144]:       <entry name="uuid">bd2d7d21-f497-4a08-8c70-946dbc83d9db</entry>
Aug 14 21:50:14 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:50:14 user nova-compute[73144]:     </system>
Aug 14 21:50:14 user nova-compute[73144]:   </sysinfo>
Aug 14 21:50:14 user nova-compute[73144]:   <os>
Aug 14 21:50:14 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:50:14 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:50:14 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:50:14 user nova-compute[73144]:   </os>
Aug 14 21:50:14 user nova-compute[73144]:   <features>
Aug 14 21:50:14 user nova-compute[73144]:     <acpi/>
Aug 14 21:50:14 user nova-compute[73144]:     <apic/>
Aug 14 21:50:14 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:50:14 user nova-compute[73144]:   </features>
Aug 14 21:50:14 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:50:14 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:50:14 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:50:14 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:50:14 user nova-compute[73144]:   </clock>
Aug 14 21:50:14 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:50:14 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:50:14 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:50:14 user nova-compute[73144]:   </cpu>
Aug 14 21:50:14 user nova-compute[73144]:   <devices>
Aug 14 21:50:14 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:50:14 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:50:14 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk"/>
Aug 14 21:50:14 user nova-compute[73144]:       <target dev="sda" bus="scsi"/>
Aug 14 21:50:14 user nova-compute[73144]:       <address type="drive" controller="0" unit="0"/>
Aug 14 21:50:14 user nova-compute[73144]:     </disk>
Aug 14 21:50:14 user nova-compute[73144]:     <disk type="file" device="cdrom">
Aug 14 21:50:14 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 21:50:14 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk.config"/>
Aug 14 21:50:14 user nova-compute[73144]:       <target dev="sdb" bus="scsi"/>
Aug 14 21:50:14 user nova-compute[73144]:       <address type="drive" controller="0" unit="1"/>
Aug 14 21:50:14 user nova-compute[73144]:     </disk>
Aug 14 21:50:14 user nova-compute[73144]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 21:50:14 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:50:14 user nova-compute[73144]:       <mac address="fa:16:3e:95:d5:8a"/>
Aug 14 21:50:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:14 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:50:14 user nova-compute[73144]:       <target dev="tapdb1673eb-0d"/>
Aug 14 21:50:14 user nova-compute[73144]:     </interface>
Aug 14 21:50:14 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:50:14 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/console.log" append="off"/>
Aug 14 21:50:14 user nova-compute[73144]:     </serial>
Aug 14 21:50:14 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:50:14 user nova-compute[73144]:     <video>
Aug 14 21:50:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:14 user nova-compute[73144]:     </video>
Aug 14 21:50:14 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:50:14 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:50:14 user nova-compute[73144]:     </rng>
Aug 14 21:50:14 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:50:14 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:50:14 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:50:14 user nova-compute[73144]:     </memballoon>
Aug 14 21:50:14 user nova-compute[73144]:   </devices>
Aug 14 21:50:14 user nova-compute[73144]: </domain>
Aug 14 21:50:14 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-375952859',display_name='tempest-AttachSCSIVolumeTestJSON-server-375952859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-375952859',id=16,image_ref='e196d1f1-d962-47f6-bafb-c464cb219da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPfe7ITLT/pSTBgorOr416fX2nVB33f6TYdXgEKdddgE8L8g4tDBy9PJt/euQpMMW+CLEUMECnQVThA71bFadTlmWl4pJlVyAx75J7v9ubk/L3hO5In1f+y2PEEESKChA==',key_name='tempest-keypair-1394412740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67bf7988794545408e34d6cb24337601',ramdisk_id='',reservation_id='r-i0x81985',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e196d1f1-d962-47f6-bafb-c464cb219da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-554340252',owner_user_name='tempest-AttachSCSIVolumeTestJSON-554340252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23bddedc457f4297967d717f946eb1e5',uuid=bd2d7d21-f497-4a08-8c70-946dbc83d9db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Converting VIF {"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:8a,bridge_name='br-int',has_traffic_filtering=True,id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a,network=Network(50fa9030-7d57-4c6c-9735-88f8f1156a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1673eb-0d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG os_vif [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:8a,bridge_name='br-int',has_traffic_filtering=True,id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a,network=Network(50fa9030-7d57-4c6c-9735-88f8f1156a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1673eb-0d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb1673eb-0d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb1673eb-0d, col_values=(('external_ids', {'iface-id': 'db1673eb-0d2f-4c7d-ab31-2d3b2aac388a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:d5:8a', 'vm-uuid': 'bd2d7d21-f497-4a08-8c70-946dbc83d9db'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:14 user nova-compute[73144]: INFO os_vif [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:8a,bridge_name='br-int',has_traffic_filtering=True,id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a,network=Network(50fa9030-7d57-4c6c-9735-88f8f1156a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1673eb-0d')
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] No BDM found with device name sda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:50:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] No VIF found with MAC fa:16:3e:95:d5:8a, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:50:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Using config drive
Aug 14 21:50:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Creating config drive at /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk.config
Aug 14 21:50:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkmby8_zw {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkmby8_zw" returned: 0 in 0.087s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid c16f9e34-3fc2-49c7-b0b8-99c5e5153818 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4394b1dd-cd2a-43e8-9580-57ef6d45ead2 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.006s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updated VIF entry in instance network info cache for port db1673eb-0d2f-4c7d-ab31-2d3b2aac388a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:50:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updating instance_info_cache with network_info: [{"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c26591ab-772e-4b08-8fd4-d77bce64af31 req-f0b6d510-ac30-4589-89da-a08a45257c06 service nova] Releasing lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:50:17 user nova-compute[73144]: INFO nova.compute.claims [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Claim successful on node user
Aug 14 21:50:17 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:50:17 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.policy [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe8b1fc0405438c99d3edd956e103a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e45dfdc13e486e950f6bc8595bb8fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Creating image(s)
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049818.6680388, bd2d7d21-f497-4a08-8c70-946dbc83d9db => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] VM Resumed (Lifecycle Event)
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Instance spawned successfully.
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049818.66833, bd2d7d21-f497-4a08-8c70-946dbc83d9db => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] VM Started (Lifecycle Event)
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Took 8.73 seconds to spawn the instance on the hypervisor.
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk 1073741824" returned: 0 in 0.065s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:18 user nova-compute[73144]: INFO nova.compute.manager [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Took 9.61 seconds to build instance.
Aug 14 21:50:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c358b63-0cec-4e94-82c7-8b4648c53ee3 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.719s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Cannot resize image /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'migration_context' on Instance uuid 6f7f7181-df25-4e9a-b990-251cabf0129c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Successfully created port: 1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Ensure instance console log exists: /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Successfully updated port: 1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received event network-changed-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Refreshing instance network info cache due to event network-changed-1fc0de81-5521-4be1-b1bc-d28db799f045. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] Acquiring lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updating instance_info_cache with network_info: [{"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Instance network_info: |[{"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] Acquired lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.neutron [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Refreshing network info cache for port 1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Start _get_guest_xml network_info=[{"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:50:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-577581934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-577581934',id=17,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-n93vdwa3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:18Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=6f7f7181-df25-4e9a-b990-251cabf0129c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:fd,bridge_name='br-int',has_traffic_filtering=True,id=1fc0de81-5521-4be1-b1bc-d28db799f045,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc0de81-55') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7f7181-df25-4e9a-b990-251cabf0129c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:50:20 user nova-compute[73144]:   <uuid>6f7f7181-df25-4e9a-b990-251cabf0129c</uuid>
Aug 14 21:50:20 user nova-compute[73144]:   <name>instance-00000011</name>
Aug 14 21:50:20 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:50:20 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:50:20 user nova-compute[73144]:   <metadata>
Aug 14 21:50:20 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:50:20 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:50:20 user nova-compute[73144]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-577581934</nova:name>
Aug 14 21:50:20 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:50:20</nova:creationTime>
Aug 14 21:50:20 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:50:20 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:50:20 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:50:20 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:50:20 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:50:20 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:50:20 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:50:20 user nova-compute[73144]:       <nova:owner>
Aug 14 21:50:20 user nova-compute[73144]:         <nova:user uuid="cfe8b1fc0405438c99d3edd956e103a4">tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member</nova:user>
Aug 14 21:50:20 user nova-compute[73144]:         <nova:project uuid="59e45dfdc13e486e950f6bc8595bb8fa">tempest-ServerBootFromVolumeStableRescueTest-847208830</nova:project>
Aug 14 21:50:20 user nova-compute[73144]:       </nova:owner>
Aug 14 21:50:20 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:50:20 user nova-compute[73144]:       <nova:ports>
Aug 14 21:50:20 user nova-compute[73144]:         <nova:port uuid="1fc0de81-5521-4be1-b1bc-d28db799f045">
Aug 14 21:50:20 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 21:50:20 user nova-compute[73144]:         </nova:port>
Aug 14 21:50:20 user nova-compute[73144]:       </nova:ports>
Aug 14 21:50:20 user nova-compute[73144]:     </nova:instance>
Aug 14 21:50:20 user nova-compute[73144]:   </metadata>
Aug 14 21:50:20 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:50:20 user nova-compute[73144]:     <system>
Aug 14 21:50:20 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:50:20 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:50:20 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:50:20 user nova-compute[73144]:       <entry name="serial">6f7f7181-df25-4e9a-b990-251cabf0129c</entry>
Aug 14 21:50:20 user nova-compute[73144]:       <entry name="uuid">6f7f7181-df25-4e9a-b990-251cabf0129c</entry>
Aug 14 21:50:20 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:50:20 user nova-compute[73144]:     </system>
Aug 14 21:50:20 user nova-compute[73144]:   </sysinfo>
Aug 14 21:50:20 user nova-compute[73144]:   <os>
Aug 14 21:50:20 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:50:20 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:50:20 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:50:20 user nova-compute[73144]:   </os>
Aug 14 21:50:20 user nova-compute[73144]:   <features>
Aug 14 21:50:20 user nova-compute[73144]:     <acpi/>
Aug 14 21:50:20 user nova-compute[73144]:     <apic/>
Aug 14 21:50:20 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:50:20 user nova-compute[73144]:   </features>
Aug 14 21:50:20 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:50:20 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:50:20 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:50:20 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:50:20 user nova-compute[73144]:   </clock>
Aug 14 21:50:20 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:50:20 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:50:20 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:50:20 user nova-compute[73144]:   </cpu>
Aug 14 21:50:20 user nova-compute[73144]:   <devices>
Aug 14 21:50:20 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:50:20 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:50:20 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk"/>
Aug 14 21:50:20 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:50:20 user nova-compute[73144]:     </disk>
Aug 14 21:50:20 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:50:20 user nova-compute[73144]:       <mac address="fa:16:3e:a4:41:fd"/>
Aug 14 21:50:20 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:20 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:50:20 user nova-compute[73144]:       <target dev="tap1fc0de81-55"/>
Aug 14 21:50:20 user nova-compute[73144]:     </interface>
Aug 14 21:50:20 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:50:20 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/console.log" append="off"/>
Aug 14 21:50:20 user nova-compute[73144]:     </serial>
Aug 14 21:50:20 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:50:20 user nova-compute[73144]:     <video>
Aug 14 21:50:20 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:20 user nova-compute[73144]:     </video>
Aug 14 21:50:20 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:50:20 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:50:20 user nova-compute[73144]:     </rng>
Aug 14 21:50:20 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:50:20 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:50:20 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:50:20 user nova-compute[73144]:     </memballoon>
Aug 14 21:50:20 user nova-compute[73144]:   </devices>
Aug 14 21:50:20 user nova-compute[73144]: </domain>
Aug 14 21:50:20 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-577581934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-577581934',id=17,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-n93vdwa3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:18Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=6f7f7181-df25-4e9a-b990-251cabf0129c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:fd,bridge_name='br-int',has_traffic_filtering=True,id=1fc0de81-5521-4be1-b1bc-d28db799f045,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc0de81-55') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG os_vif [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:fd,bridge_name='br-int',has_traffic_filtering=True,id=1fc0de81-5521-4be1-b1bc-d28db799f045,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc0de81-55') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fc0de81-55, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1fc0de81-55, col_values=(('external_ids', {'iface-id': '1fc0de81-5521-4be1-b1bc-d28db799f045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:41:fd', 'vm-uuid': '6f7f7181-df25-4e9a-b990-251cabf0129c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:20 user nova-compute[73144]: INFO os_vif [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:fd,bridge_name='br-int',has_traffic_filtering=True,id=1fc0de81-5521-4be1-b1bc-d28db799f045,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc0de81-55')
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7fdcfd4-8842-4710-b2d9-72a74c7241ba req-6e74f132-2f8a-4a32-a10e-a5292e6a7484 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7fdcfd4-8842-4710-b2d9-72a74c7241ba req-6e74f132-2f8a-4a32-a10e-a5292e6a7484 service nova] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7fdcfd4-8842-4710-b2d9-72a74c7241ba req-6e74f132-2f8a-4a32-a10e-a5292e6a7484 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7fdcfd4-8842-4710-b2d9-72a74c7241ba req-6e74f132-2f8a-4a32-a10e-a5292e6a7484 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7fdcfd4-8842-4710-b2d9-72a74c7241ba req-6e74f132-2f8a-4a32-a10e-a5292e6a7484 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] No waiting events found dispatching network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:20 user nova-compute[73144]: WARNING nova.compute.manager [req-d7fdcfd4-8842-4710-b2d9-72a74c7241ba req-6e74f132-2f8a-4a32-a10e-a5292e6a7484 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received unexpected event network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a for instance with vm_state active and task_state None.
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No VIF found with MAC fa:16:3e:a4:41:fd, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:50:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updated VIF entry in instance network info cache for port 1fc0de81-5521-4be1-b1bc-d28db799f045. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:50:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updating instance_info_cache with network_info: [{"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c5b99987-fc75-4a2d-9c22-a4ef6aa7e977 req-257ab7d8-3d30-48a8-b63f-73968700fa82 service nova] Releasing lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-eacc8a99-670f-4db0-84a6-48b968af225c req-c6574ee7-4376-4da0-8e2f-d4da49f30b41 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received event network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eacc8a99-670f-4db0-84a6-48b968af225c req-c6574ee7-4376-4da0-8e2f-d4da49f30b41 service nova] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eacc8a99-670f-4db0-84a6-48b968af225c req-c6574ee7-4376-4da0-8e2f-d4da49f30b41 service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eacc8a99-670f-4db0-84a6-48b968af225c req-c6574ee7-4376-4da0-8e2f-d4da49f30b41 service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-eacc8a99-670f-4db0-84a6-48b968af225c req-c6574ee7-4376-4da0-8e2f-d4da49f30b41 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] No waiting events found dispatching network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:22 user nova-compute[73144]: WARNING nova.compute.manager [req-eacc8a99-670f-4db0-84a6-48b968af225c req-c6574ee7-4376-4da0-8e2f-d4da49f30b41 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received unexpected event network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 for instance with vm_state building and task_state spawning.
Aug 14 21:50:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-af3f5e37-1d6c-4cfd-8e6e-20a7e899cfee req-d0f3d924-ca94-4600-ba00-60ad6ddb01b8 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af3f5e37-1d6c-4cfd-8e6e-20a7e899cfee req-d0f3d924-ca94-4600-ba00-60ad6ddb01b8 service nova] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af3f5e37-1d6c-4cfd-8e6e-20a7e899cfee req-d0f3d924-ca94-4600-ba00-60ad6ddb01b8 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af3f5e37-1d6c-4cfd-8e6e-20a7e899cfee req-d0f3d924-ca94-4600-ba00-60ad6ddb01b8 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-af3f5e37-1d6c-4cfd-8e6e-20a7e899cfee req-d0f3d924-ca94-4600-ba00-60ad6ddb01b8 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] No waiting events found dispatching network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:22 user nova-compute[73144]: WARNING nova.compute.manager [req-af3f5e37-1d6c-4cfd-8e6e-20a7e899cfee req-d0f3d924-ca94-4600-ba00-60ad6ddb01b8 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received unexpected event network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a for instance with vm_state active and task_state None.
Aug 14 21:50:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-cfab0452-0823-4d93-9868-d9a9e7f928b5 req-893d9ffd-a98a-4657-8735-f4861f2ef0ea service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received event network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cfab0452-0823-4d93-9868-d9a9e7f928b5 req-893d9ffd-a98a-4657-8735-f4861f2ef0ea service nova] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cfab0452-0823-4d93-9868-d9a9e7f928b5 req-893d9ffd-a98a-4657-8735-f4861f2ef0ea service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cfab0452-0823-4d93-9868-d9a9e7f928b5 req-893d9ffd-a98a-4657-8735-f4861f2ef0ea service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-cfab0452-0823-4d93-9868-d9a9e7f928b5 req-893d9ffd-a98a-4657-8735-f4861f2ef0ea service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] No waiting events found dispatching network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:24 user nova-compute[73144]: WARNING nova.compute.manager [req-cfab0452-0823-4d93-9868-d9a9e7f928b5 req-893d9ffd-a98a-4657-8735-f4861f2ef0ea service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received unexpected event network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 for instance with vm_state building and task_state spawning.
Aug 14 21:50:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049825.0527897, 6f7f7181-df25-4e9a-b990-251cabf0129c => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:25 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] VM Resumed (Lifecycle Event)
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:50:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Instance spawned successfully.
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:25 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049825.0529718, 6f7f7181-df25-4e9a-b990-251cabf0129c => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:25 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] VM Started (Lifecycle Event)
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:25 user nova-compute[73144]: INFO nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Took 6.91 seconds to spawn the instance on the hypervisor.
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:25 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:25 user nova-compute[73144]: INFO nova.compute.manager [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Took 8.08 seconds to build instance.
Aug 14 21:50:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2c2628a9-bb45-404d-a4f3-af959b0e66e1 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.227s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "3e6cc55c-3284-44ff-85af-642f666910da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:50:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:50:26 user nova-compute[73144]: INFO nova.compute.claims [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Claim successful on node user
Aug 14 21:50:26 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:50:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:50:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:50:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG nova.policy [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86a7e438722d4fe2b70c0546c64093d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be14e5de45434b098f04c1542b3fb835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:50:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Creating image(s)
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "/opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "/opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk 1073741824" returned: 0 in 0.051s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG nova.network.neutron [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Successfully created port: 631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.251s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:50:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Cannot resize image /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.objects.instance [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lazy-loading 'migration_context' on Instance uuid 3e6cc55c-3284-44ff-85af-642f666910da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Ensure instance console log exists: /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:28 user nova-compute[73144]: INFO nova.compute.manager [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Terminating instance
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Successfully updated port: 631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "refresh_cache-3e6cc55c-3284-44ff-85af-642f666910da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquired lock "refresh_cache-3e6cc55c-3284-44ff-85af-642f666910da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received event network-changed-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Refreshing instance network info cache due to event network-changed-631d9e61-e227-4d9d-a853-640411db0d46. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:50:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] Acquiring lock "refresh_cache-3e6cc55c-3284-44ff-85af-642f666910da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:50:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Instance destroyed successfully.
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'resources' on Instance uuid 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-993661882',display_name='tempest-VolumesAdminNegativeTest-server-993661882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-993661882',id=14,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ea8cc08442546c29ea4a251995ea832',ramdisk_id='',reservation_id='r-frto9fha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-177118256',owner_user_name='tempest-VolumesAdminNegativeTest-177118256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:48:28Z,user_data=None,user_id='894a50b95060455fb7702b1216f2adf4',uuid=8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converting VIF {"id": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "address": "fa:16:3e:29:ea:17", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe94a210-b4", "ovs_interfaceid": "fe94a210-b468-40c0-be9e-a3a3c86f047a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ea:17,bridge_name='br-int',has_traffic_filtering=True,id=fe94a210-b468-40c0-be9e-a3a3c86f047a,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe94a210-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG os_vif [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ea:17,bridge_name='br-int',has_traffic_filtering=True,id=fe94a210-b468-40c0-be9e-a3a3c86f047a,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe94a210-b4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe94a210-b4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: INFO os_vif [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ea:17,bridge_name='br-int',has_traffic_filtering=True,id=fe94a210-b468-40c0-be9e-a3a3c86f047a,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe94a210-b4')
Aug 14 21:50:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Deleting instance files /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e_del
Aug 14 21:50:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Deletion of /opt/stack/data/nova/instances/8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e_del complete
Aug 14 21:50:29 user nova-compute[73144]: INFO nova.compute.manager [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 21:50:29 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Updating instance_info_cache with network_info: [{"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Releasing lock "refresh_cache-3e6cc55c-3284-44ff-85af-642f666910da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Instance network_info: |[{"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] Acquired lock "refresh_cache-3e6cc55c-3284-44ff-85af-642f666910da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Refreshing network info cache for port 631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Start _get_guest_xml network_info=[{"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:50:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-693988685',display_name='tempest-VolumesActionsTest-instance-693988685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-693988685',id=18,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be14e5de45434b098f04c1542b3fb835',ramdisk_id='',reservation_id='r-x0opk80u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-491668790',owner_user_name='tempest-VolumesActionsTest-491668790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:27Z,user_data=None,user_id='86a7e438722d4fe2b70c0546c64093d9',uuid=3e6cc55c-3284-44ff-85af-642f666910da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converting VIF {"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:af,bridge_name='br-int',has_traffic_filtering=True,id=631d9e61-e227-4d9d-a853-640411db0d46,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631d9e61-e2') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e6cc55c-3284-44ff-85af-642f666910da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:50:29 user nova-compute[73144]:   <uuid>3e6cc55c-3284-44ff-85af-642f666910da</uuid>
Aug 14 21:50:29 user nova-compute[73144]:   <name>instance-00000012</name>
Aug 14 21:50:29 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:50:29 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:50:29 user nova-compute[73144]:   <metadata>
Aug 14 21:50:29 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:50:29 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:50:29 user nova-compute[73144]:       <nova:name>tempest-VolumesActionsTest-instance-693988685</nova:name>
Aug 14 21:50:29 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:50:29</nova:creationTime>
Aug 14 21:50:29 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:50:29 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:50:29 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:50:29 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:50:29 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:50:29 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:50:29 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:50:29 user nova-compute[73144]:       <nova:owner>
Aug 14 21:50:29 user nova-compute[73144]:         <nova:user uuid="86a7e438722d4fe2b70c0546c64093d9">tempest-VolumesActionsTest-491668790-project-member</nova:user>
Aug 14 21:50:29 user nova-compute[73144]:         <nova:project uuid="be14e5de45434b098f04c1542b3fb835">tempest-VolumesActionsTest-491668790</nova:project>
Aug 14 21:50:29 user nova-compute[73144]:       </nova:owner>
Aug 14 21:50:29 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:50:29 user nova-compute[73144]:       <nova:ports>
Aug 14 21:50:29 user nova-compute[73144]:         <nova:port uuid="631d9e61-e227-4d9d-a853-640411db0d46">
Aug 14 21:50:29 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 21:50:29 user nova-compute[73144]:         </nova:port>
Aug 14 21:50:29 user nova-compute[73144]:       </nova:ports>
Aug 14 21:50:29 user nova-compute[73144]:     </nova:instance>
Aug 14 21:50:29 user nova-compute[73144]:   </metadata>
Aug 14 21:50:29 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:50:29 user nova-compute[73144]:     <system>
Aug 14 21:50:29 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:50:29 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:50:29 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:50:29 user nova-compute[73144]:       <entry name="serial">3e6cc55c-3284-44ff-85af-642f666910da</entry>
Aug 14 21:50:29 user nova-compute[73144]:       <entry name="uuid">3e6cc55c-3284-44ff-85af-642f666910da</entry>
Aug 14 21:50:29 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:50:29 user nova-compute[73144]:     </system>
Aug 14 21:50:29 user nova-compute[73144]:   </sysinfo>
Aug 14 21:50:29 user nova-compute[73144]:   <os>
Aug 14 21:50:29 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:50:29 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:50:29 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:50:29 user nova-compute[73144]:   </os>
Aug 14 21:50:29 user nova-compute[73144]:   <features>
Aug 14 21:50:29 user nova-compute[73144]:     <acpi/>
Aug 14 21:50:29 user nova-compute[73144]:     <apic/>
Aug 14 21:50:29 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:50:29 user nova-compute[73144]:   </features>
Aug 14 21:50:29 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:50:29 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:50:29 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:50:29 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:50:29 user nova-compute[73144]:   </clock>
Aug 14 21:50:29 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:50:29 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:50:29 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:50:29 user nova-compute[73144]:   </cpu>
Aug 14 21:50:29 user nova-compute[73144]:   <devices>
Aug 14 21:50:29 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:50:29 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:50:29 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk"/>
Aug 14 21:50:29 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:50:29 user nova-compute[73144]:     </disk>
Aug 14 21:50:29 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:50:29 user nova-compute[73144]:       <mac address="fa:16:3e:16:b4:af"/>
Aug 14 21:50:29 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:29 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:50:29 user nova-compute[73144]:       <target dev="tap631d9e61-e2"/>
Aug 14 21:50:29 user nova-compute[73144]:     </interface>
Aug 14 21:50:29 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:50:29 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/console.log" append="off"/>
Aug 14 21:50:29 user nova-compute[73144]:     </serial>
Aug 14 21:50:29 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:50:29 user nova-compute[73144]:     <video>
Aug 14 21:50:29 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:29 user nova-compute[73144]:     </video>
Aug 14 21:50:29 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:50:29 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:50:29 user nova-compute[73144]:     </rng>
Aug 14 21:50:29 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:50:29 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:50:29 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:50:29 user nova-compute[73144]:     </memballoon>
Aug 14 21:50:29 user nova-compute[73144]:   </devices>
Aug 14 21:50:29 user nova-compute[73144]: </domain>
Aug 14 21:50:29 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-693988685',display_name='tempest-VolumesActionsTest-instance-693988685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-693988685',id=18,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be14e5de45434b098f04c1542b3fb835',ramdisk_id='',reservation_id='r-x0opk80u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-491668790',owner_user_name='tempest-VolumesActionsTest-491668790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:27Z,user_data=None,user_id='86a7e438722d4fe2b70c0546c64093d9',uuid=3e6cc55c-3284-44ff-85af-642f666910da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converting VIF {"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:af,bridge_name='br-int',has_traffic_filtering=True,id=631d9e61-e227-4d9d-a853-640411db0d46,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631d9e61-e2') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG os_vif [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:af,bridge_name='br-int',has_traffic_filtering=True,id=631d9e61-e227-4d9d-a853-640411db0d46,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631d9e61-e2') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap631d9e61-e2, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap631d9e61-e2, col_values=(('external_ids', {'iface-id': '631d9e61-e227-4d9d-a853-640411db0d46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b4:af', 'vm-uuid': '3e6cc55c-3284-44ff-85af-642f666910da'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:29 user nova-compute[73144]: INFO os_vif [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:af,bridge_name='br-int',has_traffic_filtering=True,id=631d9e61-e227-4d9d-a853-640411db0d46,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631d9e61-e2')
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] No VIF found with MAC fa:16:3e:16:b4:af, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Updated VIF entry in instance network info cache for port 631d9e61-e227-4d9d-a853-640411db0d46. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Updating instance_info_cache with network_info: [{"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ef9ad6d2-64f9-4c21-8a35-d199536b1aa2 req-38aa2db6-4bd3-43a0-90c7-effb20ffaf42 service nova] Releasing lock "refresh_cache-3e6cc55c-3284-44ff-85af-642f666910da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:30 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Took 1.30 seconds to deallocate network for instance.
Aug 14 21:50:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:50:30 user nova-compute[73144]: INFO nova.compute.claims [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Claim successful on node user
Aug 14 21:50:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG nova.compute.manager [req-1d3a7a26-cea2-46e5-9e91-dc9605cb8419 req-672fe867-20a9-4e99-908f-9d4ca1f7547d service nova] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Received event network-vif-deleted-fe94a210-b468-40c0-be9e-a3a3c86f047a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.637s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:50:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.policy [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '645f84b0b6c4466899b87b5f38b5698f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851048f52e82435c83e399fb66c4e889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:50:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Creating image(s)
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "/opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "/opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "/opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.208s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:31 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.704s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.330s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:32 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Deleted allocations for instance 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e
Aug 14 21:50:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk 1073741824" returned: 0 in 0.084s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.418s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e9aa56cf-0063-48a9-8ac8-1302656ec52c tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.082s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-9470b060-83cf-46be-9014-9575069db4a7 req-60f8441f-12a2-4cb0-a10e-2d994b89a0a3 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received event network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9470b060-83cf-46be-9014-9575069db4a7 req-60f8441f-12a2-4cb0-a10e-2d994b89a0a3 service nova] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9470b060-83cf-46be-9014-9575069db4a7 req-60f8441f-12a2-4cb0-a10e-2d994b89a0a3 service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9470b060-83cf-46be-9014-9575069db4a7 req-60f8441f-12a2-4cb0-a10e-2d994b89a0a3 service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-9470b060-83cf-46be-9014-9575069db4a7 req-60f8441f-12a2-4cb0-a10e-2d994b89a0a3 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] No waiting events found dispatching network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:32 user nova-compute[73144]: WARNING nova.compute.manager [req-9470b060-83cf-46be-9014-9575069db4a7 req-60f8441f-12a2-4cb0-a10e-2d994b89a0a3 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received unexpected event network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 for instance with vm_state building and task_state spawning.
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Cannot resize image /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lazy-loading 'migration_context' on Instance uuid 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Ensure instance console log exists: /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:32 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Successfully created port: f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Successfully updated port: f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquired lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-changed-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Refreshing instance network info cache due to event network-changed-f14021d9-c463-48d4-a0db-9dcbca2b75b1. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] Acquiring lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049834.0428507, 3e6cc55c-3284-44ff-85af-642f666910da => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] VM Resumed (Lifecycle Event)
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updating instance_info_cache with network_info: [{"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:50:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Instance spawned successfully.
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Releasing lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Instance network_info: |[{"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] Acquired lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Refreshing network info cache for port f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Start _get_guest_xml network_info=[{"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:34 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:34 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:50:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049834.0445864, 3e6cc55c-3284-44ff-85af-642f666910da => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] VM Started (Lifecycle Event)
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2059551550',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2059551550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2059551',id=19,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6k5ZR5oBgF37opGFaOC4gdtIrHo6vypO0duVIO2PraWsyBZKauNt6LkOG/lFgokBp9bqfmblSj/iPo3E4dOILQT8ER2WaTPJbCL7/6NN65gtAMt+CxSpmQXK+rE1wcNg==',key_name='tempest-keypair-1105846074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='851048f52e82435c83e399fb66c4e889',ramdisk_id='',reservation_id='r-zx20sonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2064149381',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645f84b0b6c4466899b87b5f38b5698f',uuid=85862011-79d3-488f-885c-e4e907d8ed2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Converting VIF {"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c7:9b,bridge_name='br-int',has_traffic_filtering=True,id=f14021d9-c463-48d4-a0db-9dcbca2b75b1,network=Network(292b23fd-ea19-4745-9a7f-9a23b6183a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14021d9-c4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lazy-loading 'pci_devices' on Instance uuid 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:34 user nova-compute[73144]: INFO nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Took 7.14 seconds to spawn the instance on the hypervisor.
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:50:34 user nova-compute[73144]:   <uuid>85862011-79d3-488f-885c-e4e907d8ed2f</uuid>
Aug 14 21:50:34 user nova-compute[73144]:   <name>instance-00000013</name>
Aug 14 21:50:34 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:50:34 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:50:34 user nova-compute[73144]:   <metadata>
Aug 14 21:50:34 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:50:34 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:50:34 user nova-compute[73144]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2059551550</nova:name>
Aug 14 21:50:34 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:50:34</nova:creationTime>
Aug 14 21:50:34 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:50:34 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:50:34 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:50:34 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:50:34 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:50:34 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:50:34 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:50:34 user nova-compute[73144]:       <nova:owner>
Aug 14 21:50:34 user nova-compute[73144]:         <nova:user uuid="645f84b0b6c4466899b87b5f38b5698f">tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member</nova:user>
Aug 14 21:50:34 user nova-compute[73144]:         <nova:project uuid="851048f52e82435c83e399fb66c4e889">tempest-TestServerVolumeAttachScenarioOldVersion-2064149381</nova:project>
Aug 14 21:50:34 user nova-compute[73144]:       </nova:owner>
Aug 14 21:50:34 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:50:34 user nova-compute[73144]:       <nova:ports>
Aug 14 21:50:34 user nova-compute[73144]:         <nova:port uuid="f14021d9-c463-48d4-a0db-9dcbca2b75b1">
Aug 14 21:50:34 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:50:34 user nova-compute[73144]:         </nova:port>
Aug 14 21:50:34 user nova-compute[73144]:       </nova:ports>
Aug 14 21:50:34 user nova-compute[73144]:     </nova:instance>
Aug 14 21:50:34 user nova-compute[73144]:   </metadata>
Aug 14 21:50:34 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:50:34 user nova-compute[73144]:     <system>
Aug 14 21:50:34 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:50:34 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:50:34 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:50:34 user nova-compute[73144]:       <entry name="serial">85862011-79d3-488f-885c-e4e907d8ed2f</entry>
Aug 14 21:50:34 user nova-compute[73144]:       <entry name="uuid">85862011-79d3-488f-885c-e4e907d8ed2f</entry>
Aug 14 21:50:34 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:50:34 user nova-compute[73144]:     </system>
Aug 14 21:50:34 user nova-compute[73144]:   </sysinfo>
Aug 14 21:50:34 user nova-compute[73144]:   <os>
Aug 14 21:50:34 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:50:34 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:50:34 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:50:34 user nova-compute[73144]:   </os>
Aug 14 21:50:34 user nova-compute[73144]:   <features>
Aug 14 21:50:34 user nova-compute[73144]:     <acpi/>
Aug 14 21:50:34 user nova-compute[73144]:     <apic/>
Aug 14 21:50:34 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:50:34 user nova-compute[73144]:   </features>
Aug 14 21:50:34 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:50:34 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:50:34 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:50:34 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:50:34 user nova-compute[73144]:   </clock>
Aug 14 21:50:34 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:50:34 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:50:34 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:50:34 user nova-compute[73144]:   </cpu>
Aug 14 21:50:34 user nova-compute[73144]:   <devices>
Aug 14 21:50:34 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:50:34 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:50:34 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk"/>
Aug 14 21:50:34 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:50:34 user nova-compute[73144]:     </disk>
Aug 14 21:50:34 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:50:34 user nova-compute[73144]:       <mac address="fa:16:3e:86:c7:9b"/>
Aug 14 21:50:34 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:34 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:50:34 user nova-compute[73144]:       <target dev="tapf14021d9-c4"/>
Aug 14 21:50:34 user nova-compute[73144]:     </interface>
Aug 14 21:50:34 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:50:34 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/console.log" append="off"/>
Aug 14 21:50:34 user nova-compute[73144]:     </serial>
Aug 14 21:50:34 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:50:34 user nova-compute[73144]:     <video>
Aug 14 21:50:34 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:34 user nova-compute[73144]:     </video>
Aug 14 21:50:34 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:50:34 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:50:34 user nova-compute[73144]:     </rng>
Aug 14 21:50:34 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:50:34 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:50:34 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:50:34 user nova-compute[73144]:     </memballoon>
Aug 14 21:50:34 user nova-compute[73144]:   </devices>
Aug 14 21:50:34 user nova-compute[73144]: </domain>
Aug 14 21:50:34 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2059551550',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2059551550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2059551',id=19,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6k5ZR5oBgF37opGFaOC4gdtIrHo6vypO0duVIO2PraWsyBZKauNt6LkOG/lFgokBp9bqfmblSj/iPo3E4dOILQT8ER2WaTPJbCL7/6NN65gtAMt+CxSpmQXK+rE1wcNg==',key_name='tempest-keypair-1105846074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='851048f52e82435c83e399fb66c4e889',ramdisk_id='',reservation_id='r-zx20sonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2064149381',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645f84b0b6c4466899b87b5f38b5698f',uuid=85862011-79d3-488f-885c-e4e907d8ed2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Converting VIF {"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c7:9b,bridge_name='br-int',has_traffic_filtering=True,id=f14021d9-c463-48d4-a0db-9dcbca2b75b1,network=Network(292b23fd-ea19-4745-9a7f-9a23b6183a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14021d9-c4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG os_vif [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c7:9b,bridge_name='br-int',has_traffic_filtering=True,id=f14021d9-c463-48d4-a0db-9dcbca2b75b1,network=Network(292b23fd-ea19-4745-9a7f-9a23b6183a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14021d9-c4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf14021d9-c4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf14021d9-c4, col_values=(('external_ids', {'iface-id': 'f14021d9-c463-48d4-a0db-9dcbca2b75b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:c7:9b', 'vm-uuid': '85862011-79d3-488f-885c-e4e907d8ed2f'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:34 user nova-compute[73144]: INFO os_vif [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c7:9b,bridge_name='br-int',has_traffic_filtering=True,id=f14021d9-c463-48d4-a0db-9dcbca2b75b1,network=Network(292b23fd-ea19-4745-9a7f-9a23b6183a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14021d9-c4')
Aug 14 21:50:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] No VIF found with MAC fa:16:3e:86:c7:9b, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:50:34 user nova-compute[73144]: INFO nova.compute.manager [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Took 8.39 seconds to build instance.
Aug 14 21:50:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-32855b04-d082-4bdb-9eff-6445bf083a36 tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "3e6cc55c-3284-44ff-85af-642f666910da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.585s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-9d7bc0b3-2ef3-46a9-b13b-bc202c93f60d req-d561c035-f2f9-4628-91f4-6eb4331bc068 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received event network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9d7bc0b3-2ef3-46a9-b13b-bc202c93f60d req-d561c035-f2f9-4628-91f4-6eb4331bc068 service nova] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9d7bc0b3-2ef3-46a9-b13b-bc202c93f60d req-d561c035-f2f9-4628-91f4-6eb4331bc068 service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9d7bc0b3-2ef3-46a9-b13b-bc202c93f60d req-d561c035-f2f9-4628-91f4-6eb4331bc068 service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-9d7bc0b3-2ef3-46a9-b13b-bc202c93f60d req-d561c035-f2f9-4628-91f4-6eb4331bc068 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] No waiting events found dispatching network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:34 user nova-compute[73144]: WARNING nova.compute.manager [req-9d7bc0b3-2ef3-46a9-b13b-bc202c93f60d req-d561c035-f2f9-4628-91f4-6eb4331bc068 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received unexpected event network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 for instance with vm_state active and task_state None.
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updated VIF entry in instance network info cache for port f14021d9-c463-48d4-a0db-9dcbca2b75b1. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updating instance_info_cache with network_info: [{"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43e0bdfb-a046-40d0-890b-4ef55c42b921 req-b514f878-7570-4903-8b32-6d477fbda622 service nova] Releasing lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb4434bb-c9d1-4551-8557-0bbed602a10b req-db8649a6-51ae-4414-97fb-55041a147217 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb4434bb-c9d1-4551-8557-0bbed602a10b req-db8649a6-51ae-4414-97fb-55041a147217 service nova] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb4434bb-c9d1-4551-8557-0bbed602a10b req-db8649a6-51ae-4414-97fb-55041a147217 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb4434bb-c9d1-4551-8557-0bbed602a10b req-db8649a6-51ae-4414-97fb-55041a147217 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb4434bb-c9d1-4551-8557-0bbed602a10b req-db8649a6-51ae-4414-97fb-55041a147217 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] No waiting events found dispatching network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:36 user nova-compute[73144]: WARNING nova.compute.manager [req-cb4434bb-c9d1-4551-8557-0bbed602a10b req-db8649a6-51ae-4414-97fb-55041a147217 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received unexpected event network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 for instance with vm_state building and task_state spawning.
Aug 14 21:50:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049838.466101, 85862011-79d3-488f-885c-e4e907d8ed2f => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] VM Resumed (Lifecycle Event)
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:50:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Instance spawned successfully.
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049838.4716196, 85862011-79d3-488f-885c-e4e907d8ed2f => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] VM Started (Lifecycle Event)
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:38 user nova-compute[73144]: INFO nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Took 7.13 seconds to spawn the instance on the hypervisor.
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-3598a0da-b336-419b-ba01-575e7823db54 req-3b0c070f-bb07-4f11-bf20-0288ece24c60 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3598a0da-b336-419b-ba01-575e7823db54 req-3b0c070f-bb07-4f11-bf20-0288ece24c60 service nova] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3598a0da-b336-419b-ba01-575e7823db54 req-3b0c070f-bb07-4f11-bf20-0288ece24c60 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3598a0da-b336-419b-ba01-575e7823db54 req-3b0c070f-bb07-4f11-bf20-0288ece24c60 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-3598a0da-b336-419b-ba01-575e7823db54 req-3b0c070f-bb07-4f11-bf20-0288ece24c60 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] No waiting events found dispatching network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:38 user nova-compute[73144]: WARNING nova.compute.manager [req-3598a0da-b336-419b-ba01-575e7823db54 req-3b0c070f-bb07-4f11-bf20-0288ece24c60 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received unexpected event network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 for instance with vm_state building and task_state spawning.
Aug 14 21:50:38 user nova-compute[73144]: INFO nova.compute.manager [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Took 8.43 seconds to build instance.
Aug 14 21:50:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d2d779bc-7eb7-4781-847c-1eb014774b49 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.726s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:50:42 user nova-compute[73144]: INFO nova.compute.claims [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Claim successful on node user
Aug 14 21:50:42 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "ef7cd461-517e-458c-a22a-d226daf54347" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG nova.policy [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d90a89f0b384bfbbabfc57e098efc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc2faa54982470a8ff513ec75cf0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:50:43 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:50:43 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:50:43 user nova-compute[73144]: INFO nova.compute.claims [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Claim successful on node user
Aug 14 21:50:43 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:50:43 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Creating image(s)
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.266s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Successfully created port: fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.265s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049829.1553936, 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:44 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] VM Stopped (Lifecycle Event)
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b7b92048-f22e-484e-9d5d-2794729a0ad3 None None] [instance: 8fbd2fc1-4718-41dc-ae13-c4c99fe6e07e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk 1073741824" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.479s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.977s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:50:44 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.254s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:50:44 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Creating image(s)
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.policy [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d90a89f0b384bfbbabfc57e098efc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc2faa54982470a8ff513ec75cf0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Cannot resize image /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'migration_context' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.233s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Successfully updated port: fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-changed-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Refreshing instance network info cache due to event network-changed-fc78b43d-4f53-4973-bd15-95772d01fdf7. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] Acquiring lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] Acquired lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Refreshing network info cache for port fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:50:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.neutron [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk 1073741824" returned: 0 in 0.097s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.neutron [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Successfully created port: 4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.neutron [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f1ada9d9-3372-4c60-ad0a-82160c09ea2b req-8fc721f6-ed02-4dcc-a595-3f045f98f63d service nova] Releasing lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Cannot resize image /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.objects.instance [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'migration_context' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Ensure instance console log exists: /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance network_info: |[{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Start _get_guest_xml network_info=[{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:50:45 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:45 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-733506174',display_name='tempest-ServerRescueNegativeTestJSON-server-733506174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-733506174',id=20,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ljinwyz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:43Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=9a143491-b86c-4768-9014-306bbeee8ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:45 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:50:46 user nova-compute[73144]:   <uuid>9a143491-b86c-4768-9014-306bbeee8ad9</uuid>
Aug 14 21:50:46 user nova-compute[73144]:   <name>instance-00000014</name>
Aug 14 21:50:46 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:50:46 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:50:46 user nova-compute[73144]:   <metadata>
Aug 14 21:50:46 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:50:46 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-733506174</nova:name>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:50:45</nova:creationTime>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:50:46 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:50:46 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:owner>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:user uuid="8d90a89f0b384bfbbabfc57e098efc45">tempest-ServerRescueNegativeTestJSON-89538024-project-member</nova:user>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:project uuid="8cc2faa54982470a8ff513ec75cf0546">tempest-ServerRescueNegativeTestJSON-89538024</nova:project>
Aug 14 21:50:46 user nova-compute[73144]:       </nova:owner>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:ports>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:port uuid="fc78b43d-4f53-4973-bd15-95772d01fdf7">
Aug 14 21:50:46 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:50:46 user nova-compute[73144]:         </nova:port>
Aug 14 21:50:46 user nova-compute[73144]:       </nova:ports>
Aug 14 21:50:46 user nova-compute[73144]:     </nova:instance>
Aug 14 21:50:46 user nova-compute[73144]:   </metadata>
Aug 14 21:50:46 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:50:46 user nova-compute[73144]:     <system>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="serial">9a143491-b86c-4768-9014-306bbeee8ad9</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="uuid">9a143491-b86c-4768-9014-306bbeee8ad9</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:50:46 user nova-compute[73144]:     </system>
Aug 14 21:50:46 user nova-compute[73144]:   </sysinfo>
Aug 14 21:50:46 user nova-compute[73144]:   <os>
Aug 14 21:50:46 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:50:46 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:50:46 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:50:46 user nova-compute[73144]:   </os>
Aug 14 21:50:46 user nova-compute[73144]:   <features>
Aug 14 21:50:46 user nova-compute[73144]:     <acpi/>
Aug 14 21:50:46 user nova-compute[73144]:     <apic/>
Aug 14 21:50:46 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:50:46 user nova-compute[73144]:   </features>
Aug 14 21:50:46 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:50:46 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:50:46 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:50:46 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:50:46 user nova-compute[73144]:   </clock>
Aug 14 21:50:46 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:50:46 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:50:46 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:50:46 user nova-compute[73144]:   </cpu>
Aug 14 21:50:46 user nova-compute[73144]:   <devices>
Aug 14 21:50:46 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:50:46 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:50:46 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk"/>
Aug 14 21:50:46 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:50:46 user nova-compute[73144]:     </disk>
Aug 14 21:50:46 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:50:46 user nova-compute[73144]:       <mac address="fa:16:3e:ff:51:af"/>
Aug 14 21:50:46 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:46 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:50:46 user nova-compute[73144]:       <target dev="tapfc78b43d-4f"/>
Aug 14 21:50:46 user nova-compute[73144]:     </interface>
Aug 14 21:50:46 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:50:46 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/console.log" append="off"/>
Aug 14 21:50:46 user nova-compute[73144]:     </serial>
Aug 14 21:50:46 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:50:46 user nova-compute[73144]:     <video>
Aug 14 21:50:46 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:46 user nova-compute[73144]:     </video>
Aug 14 21:50:46 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:50:46 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:50:46 user nova-compute[73144]:     </rng>
Aug 14 21:50:46 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:50:46 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:50:46 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:50:46 user nova-compute[73144]:     </memballoon>
Aug 14 21:50:46 user nova-compute[73144]:   </devices>
Aug 14 21:50:46 user nova-compute[73144]: </domain>
Aug 14 21:50:46 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-733506174',display_name='tempest-ServerRescueNegativeTestJSON-server-733506174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-733506174',id=20,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ljinwyz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:43Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=9a143491-b86c-4768-9014-306bbeee8ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG os_vif [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc78b43d-4f, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc78b43d-4f, col_values=(('external_ids', {'iface-id': 'fc78b43d-4f53-4973-bd15-95772d01fdf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:51:af', 'vm-uuid': '9a143491-b86c-4768-9014-306bbeee8ad9'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: INFO os_vif [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f')
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No VIF found with MAC fa:16:3e:ff:51:af, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Successfully updated port: 4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-changed-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Refreshing instance network info cache due to event network-changed-4e4e40c9-2a43-419d-b137-1ffaef720831. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] Acquiring lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updating instance_info_cache with network_info: [{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance network_info: |[{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] Acquired lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.neutron [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Refreshing network info cache for port 4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Start _get_guest_xml network_info=[{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:50:46 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:46 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1484744198',display_name='tempest-ServerRescueNegativeTestJSON-server-1484744198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1484744198',id=21,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-aky6v03n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:45Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=ef7cd461-517e-458c-a22a-d226daf54347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.objects.instance [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'pci_devices' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:50:46 user nova-compute[73144]:   <uuid>ef7cd461-517e-458c-a22a-d226daf54347</uuid>
Aug 14 21:50:46 user nova-compute[73144]:   <name>instance-00000015</name>
Aug 14 21:50:46 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:50:46 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:50:46 user nova-compute[73144]:   <metadata>
Aug 14 21:50:46 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:50:46 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1484744198</nova:name>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:50:46</nova:creationTime>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:50:46 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:50:46 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:owner>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:user uuid="8d90a89f0b384bfbbabfc57e098efc45">tempest-ServerRescueNegativeTestJSON-89538024-project-member</nova:user>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:project uuid="8cc2faa54982470a8ff513ec75cf0546">tempest-ServerRescueNegativeTestJSON-89538024</nova:project>
Aug 14 21:50:46 user nova-compute[73144]:       </nova:owner>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:50:46 user nova-compute[73144]:       <nova:ports>
Aug 14 21:50:46 user nova-compute[73144]:         <nova:port uuid="4e4e40c9-2a43-419d-b137-1ffaef720831">
Aug 14 21:50:46 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:50:46 user nova-compute[73144]:         </nova:port>
Aug 14 21:50:46 user nova-compute[73144]:       </nova:ports>
Aug 14 21:50:46 user nova-compute[73144]:     </nova:instance>
Aug 14 21:50:46 user nova-compute[73144]:   </metadata>
Aug 14 21:50:46 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:50:46 user nova-compute[73144]:     <system>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="serial">ef7cd461-517e-458c-a22a-d226daf54347</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="uuid">ef7cd461-517e-458c-a22a-d226daf54347</entry>
Aug 14 21:50:46 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:50:46 user nova-compute[73144]:     </system>
Aug 14 21:50:46 user nova-compute[73144]:   </sysinfo>
Aug 14 21:50:46 user nova-compute[73144]:   <os>
Aug 14 21:50:46 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:50:46 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:50:46 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:50:46 user nova-compute[73144]:   </os>
Aug 14 21:50:46 user nova-compute[73144]:   <features>
Aug 14 21:50:46 user nova-compute[73144]:     <acpi/>
Aug 14 21:50:46 user nova-compute[73144]:     <apic/>
Aug 14 21:50:46 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:50:46 user nova-compute[73144]:   </features>
Aug 14 21:50:46 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:50:46 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:50:46 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:50:46 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:50:46 user nova-compute[73144]:   </clock>
Aug 14 21:50:46 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:50:46 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:50:46 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:50:46 user nova-compute[73144]:   </cpu>
Aug 14 21:50:46 user nova-compute[73144]:   <devices>
Aug 14 21:50:46 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:50:46 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:50:46 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk"/>
Aug 14 21:50:46 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:50:46 user nova-compute[73144]:     </disk>
Aug 14 21:50:46 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:50:46 user nova-compute[73144]:       <mac address="fa:16:3e:fc:b4:58"/>
Aug 14 21:50:46 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:46 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:50:46 user nova-compute[73144]:       <target dev="tap4e4e40c9-2a"/>
Aug 14 21:50:46 user nova-compute[73144]:     </interface>
Aug 14 21:50:46 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:50:46 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/console.log" append="off"/>
Aug 14 21:50:46 user nova-compute[73144]:     </serial>
Aug 14 21:50:46 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:50:46 user nova-compute[73144]:     <video>
Aug 14 21:50:46 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:50:46 user nova-compute[73144]:     </video>
Aug 14 21:50:46 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:50:46 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:50:46 user nova-compute[73144]:     </rng>
Aug 14 21:50:46 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:50:46 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:50:46 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:50:46 user nova-compute[73144]:     </memballoon>
Aug 14 21:50:46 user nova-compute[73144]:   </devices>
Aug 14 21:50:46 user nova-compute[73144]: </domain>
Aug 14 21:50:46 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1484744198',display_name='tempest-ServerRescueNegativeTestJSON-server-1484744198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1484744198',id=21,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-aky6v03n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:45Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=ef7cd461-517e-458c-a22a-d226daf54347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG os_vif [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e4e40c9-2a, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e4e40c9-2a, col_values=(('external_ids', {'iface-id': '4e4e40c9-2a43-419d-b137-1ffaef720831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:b4:58', 'vm-uuid': 'ef7cd461-517e-458c-a22a-d226daf54347'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:46 user nova-compute[73144]: INFO os_vif [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a')
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:50:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No VIF found with MAC fa:16:3e:fc:b4:58, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:50:47 user nova-compute[73144]: DEBUG nova.network.neutron [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updated VIF entry in instance network info cache for port 4e4e40c9-2a43-419d-b137-1ffaef720831. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:50:47 user nova-compute[73144]: DEBUG nova.network.neutron [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updating instance_info_cache with network_info: [{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9cb5ad6e-3675-4f8b-92d8-15002a710daf req-3ac1dff7-d181-458b-aa53-f70461544cdf service nova] Releasing lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-45be2275-1143-4dee-b4da-105529d7e858 req-a4e3d71e-0bc9-4c16-84dd-6f01783b9a24 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-45be2275-1143-4dee-b4da-105529d7e858 req-a4e3d71e-0bc9-4c16-84dd-6f01783b9a24 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-45be2275-1143-4dee-b4da-105529d7e858 req-a4e3d71e-0bc9-4c16-84dd-6f01783b9a24 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-45be2275-1143-4dee-b4da-105529d7e858 req-a4e3d71e-0bc9-4c16-84dd-6f01783b9a24 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-45be2275-1143-4dee-b4da-105529d7e858 req-a4e3d71e-0bc9-4c16-84dd-6f01783b9a24 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:48 user nova-compute[73144]: WARNING nova.compute.manager [req-45be2275-1143-4dee-b4da-105529d7e858 req-a4e3d71e-0bc9-4c16-84dd-6f01783b9a24 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state building and task_state spawning.
Aug 14 21:50:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-changed-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Refreshing instance network info cache due to event network-changed-6f7e06eb-2d48-431d-9305-24dc4801c99a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] Acquiring lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] Acquired lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:48 user nova-compute[73144]: DEBUG nova.network.neutron [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Refreshing network info cache for port 6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:50:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:49 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.objects.instance [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'flavor' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updated VIF entry in instance network info cache for port 6f7e06eb-2d48-431d-9305-24dc4801c99a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updating instance_info_cache with network_info: [{"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b47b13aa-434f-474a-a5a5-33e92f760968 req-7558fb46-d0c9-4502-ad11-4aec0f25b074 service nova] Releasing lock "refresh_cache-ea802951-a15c-4dac-a693-4fe96ef3cc9f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:50 user nova-compute[73144]: WARNING nova.compute.manager [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state building and task_state spawning.
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:50 user nova-compute[73144]: WARNING nova.compute.manager [req-6b19963c-61c9-4d68-b296-5ff657f5ae26 req-da152d04-de76-4607-959d-92a5109e1f54 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received unexpected event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with vm_state building and task_state spawning.
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:50 user nova-compute[73144]: INFO nova.compute.manager [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Attaching volume 4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 to /dev/vdb
Aug 14 21:50:50 user nova-compute[73144]: DEBUG os_brick.utils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c9e8e1-04d0-4073-86f9-64c1631d3c04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[50babc41-a5fd-4f3a-9b5b-458370c36e7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2589e6-b0eb-4b71-84c4-c0eb0fc87b44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[291cf31f-af21-4e5e-ae50-0b7fe835a7e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:50:50 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:50:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09f0c6-90e0-44cd-b9a5-0e78afbe9350]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG os_brick.utils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:50:50 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updating existing volume attachment record: 938f47e0-d810-4218-8cbd-eecd60308999 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049851.3739648, 9a143491-b86c-4768-9014-306bbeee8ad9 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] VM Resumed (Lifecycle Event)
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance spawned successfully.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049851.3766413, 9a143491-b86c-4768-9014-306bbeee8ad9 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] VM Started (Lifecycle Event)
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049851.4790733, ef7cd461-517e-458c-a22a-d226daf54347 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] VM Resumed (Lifecycle Event)
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance spawned successfully.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Took 8.04 seconds to spawn the instance on the hypervisor.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049851.4813368, ef7cd461-517e-458c-a22a-d226daf54347 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] VM Started (Lifecycle Event)
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Took 9.39 seconds to build instance.
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c36c37bf-2850-4d74-b32f-41615a248652 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.500s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:51 user nova-compute[73144]: INFO nova.compute.manager [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Took 8.41 seconds to build instance.
Aug 14 21:50:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-103ba2d0-cd75-441e-8952-b0bcf88fe3a3 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "ef7cd461-517e-458c-a22a-d226daf54347" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.899s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-0a3f1021-3a4c-4abb-a79a-0c7a78166e45 req-64737798-424f-4d5c-ab5d-dc47943828dc service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0a3f1021-3a4c-4abb-a79a-0c7a78166e45 req-64737798-424f-4d5c-ab5d-dc47943828dc service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0a3f1021-3a4c-4abb-a79a-0c7a78166e45 req-64737798-424f-4d5c-ab5d-dc47943828dc service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0a3f1021-3a4c-4abb-a79a-0c7a78166e45 req-64737798-424f-4d5c-ab5d-dc47943828dc service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-0a3f1021-3a4c-4abb-a79a-0c7a78166e45 req-64737798-424f-4d5c-ab5d-dc47943828dc service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:52 user nova-compute[73144]: WARNING nova.compute.manager [req-0a3f1021-3a4c-4abb-a79a-0c7a78166e45 req-64737798-424f-4d5c-ab5d-dc47943828dc service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received unexpected event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with vm_state active and task_state None.
Aug 14 21:50:54 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:50:55 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 21:50:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 21:50:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:56 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 21:50:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:57 user nova-compute[73144]: INFO nova.compute.manager [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Terminating instance
Aug 14 21:50:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-d2cf5692-1566-43d2-8429-d3aef174b20d req-48cbb2b5-aaee-4a8c-85ea-91836275bc74 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-vif-unplugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d2cf5692-1566-43d2-8429-d3aef174b20d req-48cbb2b5-aaee-4a8c-85ea-91836275bc74 service nova] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d2cf5692-1566-43d2-8429-d3aef174b20d req-48cbb2b5-aaee-4a8c-85ea-91836275bc74 service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d2cf5692-1566-43d2-8429-d3aef174b20d req-48cbb2b5-aaee-4a8c-85ea-91836275bc74 service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-d2cf5692-1566-43d2-8429-d3aef174b20d req-48cbb2b5-aaee-4a8c-85ea-91836275bc74 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] No waiting events found dispatching network-vif-unplugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-d2cf5692-1566-43d2-8429-d3aef174b20d req-48cbb2b5-aaee-4a8c-85ea-91836275bc74 service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-vif-unplugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:50:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Instance destroyed successfully.
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.objects.instance [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'resources' on Instance uuid c16f9e34-3fc2-49c7-b0b8-99c5e5153818 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-890878732',display_name='tempest-AttachVolumeNegativeTest-server-890878732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-890878732',id=2,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6DEttn99Q70VbYA9BkbePkssK/853vx1OLoWAwbjIzFFx8pp3oLBwBF8HMUjAHLmjOjyz1EKf+Ckzeyhm6J7uUmWqAVIOUVVWq9esjMTnECL3PTZZOFAb7fwQbAlXOvw==',key_name='tempest-keypair-374539220',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-8ws9jj9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=c16f9e34-3fc2-49c7-b0b8-99c5e5153818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "address": "fa:16:3e:5d:e4:20", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a900812-f1", "ovs_interfaceid": "5a900812-f1ea-4f9e-bff4-84e9e72f5f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:e4:20,bridge_name='br-int',has_traffic_filtering=True,id=5a900812-f1ea-4f9e-bff4-84e9e72f5f42,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a900812-f1') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG os_vif [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:e4:20,bridge_name='br-int',has_traffic_filtering=True,id=5a900812-f1ea-4f9e-bff4-84e9e72f5f42,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a900812-f1') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a900812-f1, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:50:58 user nova-compute[73144]: INFO os_vif [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:e4:20,bridge_name='br-int',has_traffic_filtering=True,id=5a900812-f1ea-4f9e-bff4-84e9e72f5f42,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a900812-f1')
Aug 14 21:50:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Deleting instance files /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818_del
Aug 14 21:50:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Deletion of /opt/stack/data/nova/instances/c16f9e34-3fc2-49c7-b0b8-99c5e5153818_del complete
Aug 14 21:50:58 user nova-compute[73144]: INFO nova.compute.manager [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:50:58 user nova-compute[73144]: INFO nova.compute.manager [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Unrescuing
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:50:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'flavor' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:50:59 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Took 1.21 seconds to deallocate network for instance.
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json" returned: 0 in 0.371s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-0697fb3c-d560-40d9-9b8c-72d62ba1affd req-005e7608-da06-49b5-99c3-8b901c3c4756 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0697fb3c-d560-40d9-9b8c-72d62ba1affd req-005e7608-da06-49b5-99c3-8b901c3c4756 service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0697fb3c-d560-40d9-9b8c-72d62ba1affd req-005e7608-da06-49b5-99c3-8b901c3c4756 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0697fb3c-d560-40d9-9b8c-72d62ba1affd req-005e7608-da06-49b5-99c3-8b901c3c4756 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:50:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-0697fb3c-d560-40d9-9b8c-72d62ba1affd req-005e7608-da06-49b5-99c3-8b901c3c4756 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:50:59 user nova-compute[73144]: WARNING nova.compute.manager [req-0697fb3c-d560-40d9-9b8c-72d62ba1affd req-005e7608-da06-49b5-99c3-8b901c3c4756 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:50:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-bfd9eb7c-f304-4e6c-ad66-3ae787337c05 req-09ad9386-b3d1-48f6-97aa-a59a74a6279f service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bfd9eb7c-f304-4e6c-ad66-3ae787337c05 req-09ad9386-b3d1-48f6-97aa-a59a74a6279f service nova] Acquiring lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bfd9eb7c-f304-4e6c-ad66-3ae787337c05 req-09ad9386-b3d1-48f6-97aa-a59a74a6279f service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bfd9eb7c-f304-4e6c-ad66-3ae787337c05 req-09ad9386-b3d1-48f6-97aa-a59a74a6279f service nova] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-bfd9eb7c-f304-4e6c-ad66-3ae787337c05 req-09ad9386-b3d1-48f6-97aa-a59a74a6279f service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] No waiting events found dispatching network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:00 user nova-compute[73144]: WARNING nova.compute.manager [req-bfd9eb7c-f304-4e6c-ad66-3ae787337c05 req-09ad9386-b3d1-48f6-97aa-a59a74a6279f service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received unexpected event network-vif-plugged-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 for instance with vm_state deleted and task_state None.
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-bfd9eb7c-f304-4e6c-ad66-3ae787337c05 req-09ad9386-b3d1-48f6-97aa-a59a74a6279f service nova] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Received event network-vif-deleted-5a900812-f1ea-4f9e-bff4-84e9e72f5f42 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing instance network info cache due to event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.network.neutron [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 21:51:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance destroyed successfully.
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:00 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:00 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:00 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a340e32e-a74c-4b5b-bfc0-4a412eb45167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:51:00 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.network.neutron [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updated VIF entry in instance network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG nova.network.neutron [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4830bc-c77c-4b59-b936-33fa9ef1b5b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4] added
Aug 14 21:51:00 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdaba43-4572-43ab-b081-2493f6362cc1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-833e0bd0-b28f-4180-8361-d6184d49064b req-dc7aaa7c-299a-48b7-abde-47b62f405cd9 service nova] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.278s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[077e85c2-3d09-4043-9d21-0522bc8481c9]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njWFHoVS {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njWFHoVS" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ce3c6-a1ee-487a-aff0-f99e5167ada8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Deleted allocations for instance c16f9e34-3fc2-49c7-b0b8-99c5e5153818
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'njWFHoVS'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef19a62-fe91-46ab-b258-708884e56d93]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8aadbf-12bf-4377-9f65-8cfba492461e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7d4912a6-efa9-4ad9-99da-e31ce57ad18d tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "c16f9e34-3fc2-49c7-b0b8-99c5e5153818" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.744s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c7bd2-8da4-4ade-906a-da4f686b94fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]
Aug 14 21:51:01 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.
Aug 14 21:51:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74e52c1-4601-4abd-8b2c-f9f646a09581]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3111126-d361-4ab5-8bb6-9f3c2fb044a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf8dbc0-249c-463a-8237-92c2ec0af518]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:02 user nova-compute[73144]: WARNING nova.compute.manager [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:02 user nova-compute[73144]: WARNING nova.compute.manager [req-d3e3f31a-6185-42c2-8356-a93462a372f7 req-e580b166-8745-4944-b7c3-89019b9818c4 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing instance network info cache due to event network-changed-3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] Acquiring lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] Acquired lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Refreshing network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.512s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== connect_volume: return (1516ms) {'type': 'block', 'scsi_wwn': '26265633434333161', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265633434333161', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'flavor' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:51:02 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:02 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:51:02 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:51:02 user nova-compute[73144]:   <serial>4e5d8bd2-73d2-48b1-9b99-32dca17dfde4</serial>
Aug 14 21:51:02 user nova-compute[73144]: </disk>
Aug 14 21:51:02 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updated VIF entry in instance network info cache for port 3637b061-93ae-454c-88ff-45478c8bdcda. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [{"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2362319f-2c28-406d-ac5b-aa1de088c3a1 req-b360b185-6662-40a3-a7f1-fc1f267041be service nova] Releasing lock "refresh_cache-ae3ee52c-0811-4c67-a43e-736e02c5511d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:51:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No VIF found with MAC fa:16:3e:4a:bd:e4, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3fbd7210-989a-4c55-9ca0-b5d6c5352a02 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.660s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for ae3ee52c-0811-4c67-a43e-736e02c5511d due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049864.0478554, ae3ee52c-0811-4c67-a43e-736e02c5511d => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] VM Resumed (Lifecycle Event)
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ddc94eb6-a164-4a11-af2e-338fa1b721b3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049864.0487828, ae3ee52c-0811-4c67-a43e-736e02c5511d => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] VM Started (Lifecycle Event)
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-51f7d0c5-b910-4eaf-8763-f763fa9a0a88 req-694753d0-1b4a-43ba-add6-84463a4b1604 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-51f7d0c5-b910-4eaf-8763-f763fa9a0a88 req-694753d0-1b4a-43ba-add6-84463a4b1604 service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-51f7d0c5-b910-4eaf-8763-f763fa9a0a88 req-694753d0-1b4a-43ba-add6-84463a4b1604 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-51f7d0c5-b910-4eaf-8763-f763fa9a0a88 req-694753d0-1b4a-43ba-add6-84463a4b1604 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-51f7d0c5-b910-4eaf-8763-f763fa9a0a88 req-694753d0-1b4a-43ba-add6-84463a4b1604 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:04 user nova-compute[73144]: WARNING nova.compute.manager [req-51f7d0c5-b910-4eaf-8763-f763fa9a0a88 req-694753d0-1b4a-43ba-add6-84463a4b1604 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:51:04 user nova-compute[73144]: INFO nova.compute.manager [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Rebuilding instance
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:04 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:51:04 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=6893MB free_disk=25.293964385986328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'pci_requests' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'pci_devices' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'resources' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'migration_context' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Applying migration context for instance abb6bbee-268b-45c6-b3da-49ecc86944c0 as it has an incoming, in-progress migration 1ef8505c-55bf-400b-8199-237c8494fa58. Migration status is reverting {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 21:51:04 user nova-compute[73144]: INFO nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating resource usage from migration 1ef8505c-55bf-400b-8199-237c8494fa58
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73144) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Port 758cbe79-b4b9-40b7-93a4-37b07664efb4 binding to destination host user is already ACTIVE {{(pid=73144) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:51:04 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ae3ee52c-0811-4c67-a43e-736e02c5511d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4583cc14-41a8-46b7-85d5-440efba5ec4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ea802951-a15c-4dac-a693-4fe96ef3cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Migration 1ef8505c-55bf-400b-8199-237c8494fa58 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance bd2d7d21-f497-4a08-8c70-946dbc83d9db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3e6cc55c-3284-44ff-85af-642f666910da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 85862011-79d3-488f-885c-e4e907d8ed2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-4bf1ad65-46f7-40e0-99c1-d13b5bcc92f2 req-6f0920c4-8299-4fce-bb51-11dc2fc1d050 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-unplugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4bf1ad65-46f7-40e0-99c1-d13b5bcc92f2 req-6f0920c4-8299-4fce-bb51-11dc2fc1d050 service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4bf1ad65-46f7-40e0-99c1-d13b5bcc92f2 req-6f0920c4-8299-4fce-bb51-11dc2fc1d050 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4bf1ad65-46f7-40e0-99c1-d13b5bcc92f2 req-6f0920c4-8299-4fce-bb51-11dc2fc1d050 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-4bf1ad65-46f7-40e0-99c1-d13b5bcc92f2 req-6f0920c4-8299-4fce-bb51-11dc2fc1d050 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-unplugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:05 user nova-compute[73144]: WARNING nova.compute.manager [req-4bf1ad65-46f7-40e0-99c1-d13b5bcc92f2 req-6f0920c4-8299-4fce-bb51-11dc2fc1d050 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received unexpected event network-vif-unplugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with vm_state active and task_state rebuilding.
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:51:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.119s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:06 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance destroyed successfully.
Aug 14 21:51:06 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Creating tmpfile /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/tmp5f6ct6kl to verify with other compute node that the instance is on the same shared storage. {{(pid=73144) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:06 user nova-compute[73144]: INFO nova.compute.manager [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Detaching volume 4e5d8bd2-73d2-48b1-9b99-32dca17dfde4
Aug 14 21:51:06 user nova-compute[73144]: INFO nova.virt.block_device [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Attempting to driver detach volume 4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 from mountpoint /dev/vdb
Aug 14 21:51:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Attempting to detach device vdb from instance ea802951-a15c-4dac-a693-4fe96ef3cc9f from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:51:06 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:06 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:51:06 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:51:06 user nova-compute[73144]:   <serial>4e5d8bd2-73d2-48b1-9b99-32dca17dfde4</serial>
Aug 14 21:51:06 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:51:06 user nova-compute[73144]: </disk>
Aug 14 21:51:06 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:51:06 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully detached device vdb from instance ea802951-a15c-4dac-a693-4fe96ef3cc9f from the persistent domain config.
Aug 14 21:51:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:06 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:51:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a604fb-ce4a-4fd2-96d7-f0a64e55bd3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[171eb777-ce20-4e71-818e-9926f82ea38a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586abc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b6dd7a-7264-494b-8436-626863bd70c8]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da6a9a-22d8-45b3-bf6b-423aa61de05c]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb064bac-cbda-46b6-bafc-e6895e707b72]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c30a881-fbb4-4f9e-ab50-b2b2d4158f06]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance destroyed successfully.
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'resources' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_vif [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba26b6a-61dc-4a10-9717-f7f915335a0c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap758cbe79-b4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:07 user nova-compute[73144]: INFO os_vif [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4')
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:07 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd93253-de30-4d8f-a521-f060ce337975]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]
Aug 14 21:51:07 user nova-compute[73144]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.
Aug 14 21:51:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d16c9f2-b233-44d8-b1c2-df66e2517136]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.743s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== disconnect_volume: return (752ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.111s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.042s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[646cb984-cb33-4607-9588-e168e6b90d80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7531ae-caed-4294-9e87-3c306fe102a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:07 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158474ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd141c45-ad73-4ba5-9662-cd1d2e2ee106]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[916d517a-1771-4d6b-9208-5e10c5cc8477]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67bfce-db17-4113-a7a0-eba44955efc8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:07 user nova-compute[73144]: WARNING nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received unexpected event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with vm_state active and task_state rebuilding.
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-unplugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-unplugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:07 user nova-compute[73144]: WARNING nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-unplugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state resized and task_state resize_reverting.
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:07 user nova-compute[73144]: WARNING nova.compute.manager [req-dc73f819-997a-4f9f-a011-3abf6bb06ffa req-947dfb44-1fee-4b82-9913-97bd746b4e62 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state resized and task_state resize_reverting.
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace3e74-7278-422f-a946-077920db559f]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[68085c86-6c38-4074-bc62-cde30f4f0321]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.168s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f7917-aaee-4164-9b17-9165e1d4a84f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]
Aug 14 21:51:08 user nova-compute[73144]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.
Aug 14 21:51:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcebc49a-f5ad-448b-b128-a8689d157c0d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== disconnect_volume: return (567ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance destroyed successfully.
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1593031860',display_name='tempest-ServerActionsTestOtherA-server-1475160519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1593031860',id=15,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqCumZ/fmgKOc7IfkPXpmLzqkGmsWcfXH/aHSLL63EIDPCYrbA7aV6dRIW5fpx+mmgIckHG/r4NRGJy6RPYUzNm64l35X06MrWUIA4QzuIwUkrvl1av/AdaNxdmexJsw==',key_name='tempest-keypair-1493275970',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-ffz2q41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=ea802951-a15c-4dac-a693-4fe96ef3cc9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_vif [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f7e06eb-2d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:08 user nova-compute[73144]: INFO os_vif [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d')
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:08 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[df39aab6-f4d1-4f40-8e12-633f2fd64d07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[72592221-c8c0-4c22-a8ab-c45e16cd4f5c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:08 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:08 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586bae60>, {}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Disconnecting from: [] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== disconnect_volume: return (54ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:51:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Deleting instance files /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f_del
Aug 14 21:51:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Deletion of /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f_del complete
Aug 14 21:51:08 user nova-compute[73144]: INFO nova.virt.block_device [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Booting with volume 4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 at /dev/vdb
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.utils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a831c5bd-7e6e-4750-a043-9fc68254ae5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e7f9d9-7ba9-4344-a404-625d1e5e2d3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df0e098-1e14-41fb-989a-240dbe43268d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9863aa23-1ca0-484e-b34d-6231e57b0e11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:51:08 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:51:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[599f7c0b-8daf-40a7-9308-3ace585a1881]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG os_brick.utils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:08 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updating existing volume attachment record: e8c3cfcc-4e8e-4e0d-a254-b8d16d4739f2 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:51:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:09 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'migration_context' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:09 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:51:09 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:51:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.547s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:09 user nova-compute[73144]: INFO nova.compute.manager [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Swapping old allocation on dict_keys(['fcca1cea-a902-4b33-85fb-860d4db9f73e']) held by migration 1ef8505c-55bf-400b-8199-237c8494fa58 for instance
Aug 14 21:51:09 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Overwriting current allocation {'allocations': {'fcca1cea-a902-4b33-85fb-860d4db9f73e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '1c3eaba4f7824769adb0e2a2a28f3924', 'user_id': 'f24af35347484e5982207ed21f62bc2a', 'consumer_generation': 1} on consumer abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquired lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Releasing lock "refresh_cache-abb6bbee-268b-45c6-b3da-49ecc86944c0" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG os_brick.utils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2026ac23-8119-4c3a-a16c-810b8389a6e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1da948-96c8-42a4-9153-74bf301631c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f1f999-4c9e-4289-bc18-71f847f86441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2667a195-9ebe-4173-9a87-90f516479b5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:51:10 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:51:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea37d75-3ca9-45d8-8a10-0f9563d73ec5]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:51:10 user nova-compute[73144]: DEBUG os_brick.utils [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:13 user nova-compute[73144]: INFO nova.compute.manager [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Detaching volume 3d78c19b-023d-485d-a2d5-7a7ca3f7fde0
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049858.222862, c16f9e34-3fc2-49c7-b0b8-99c5e5153818 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:13 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] VM Stopped (Lifecycle Event)
Aug 14 21:51:13 user nova-compute[73144]: INFO nova.virt.block_device [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Attempting to driver detach volume 3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 from mountpoint /dev/vdb
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d5b16b27-32c2-47b9-9cb3-61023e290c87 None None] [instance: c16f9e34-3fc2-49c7-b0b8-99c5e5153818] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Attempting to detach device vdb from instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:51:13 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:13 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:51:13 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:51:13 user nova-compute[73144]:   <serial>3d78c19b-023d-485d-a2d5-7a7ca3f7fde0</serial>
Aug 14 21:51:13 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 21:51:13 user nova-compute[73144]: </disk>
Aug 14 21:51:13 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:51:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully detached device vdb from instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 from the persistent domain config.
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:51:13 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:13 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:51:13 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:51:13 user nova-compute[73144]:   <serial>3d78c19b-023d-485d-a2d5-7a7ca3f7fde0</serial>
Aug 14 21:51:13 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 21:51:13 user nova-compute[73144]: </disk>
Aug 14 21:51:13 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049873.7064188, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:51:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully detached device vdb from instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 from the live domain config.
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCjNgyrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:13 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b3a93-0e91-4d15-8a69-fa2782ca6ae2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e7a0cd-6845-4291-aaee-8179a4cedefb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:13 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:13 user nova-compute[73144]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 (non-flash)
Aug 14 21:51:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158476b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa451f-dac9-4927-9346-edce745d5beb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6166b502-0293-4495-b4d8-180decc1442d]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe47b3-95e3-4ca7-9c4f-edbdbf4d009f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf5f5be-f5f3-4bf5-be90-1a885e0cfcb7]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b386e808-2345-469a-b385-29be5213a445]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e7906c-c6e4-416f-b72c-e45d03193404]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260]
Aug 14 21:51:13 user nova-compute[73144]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0, portal: 172.16.0.220,3260] successful.
Aug 14 21:51:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d78c19b-023d-485d-a2d5-7a7ca3f7fde0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259e99c-98ac-46ea-9a0c-18ec41f9928b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== disconnect_volume: return (275ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:51:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b70e17bf-9b01-43f6-9a2d-19d317c1d703 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.698s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8af80bd5-a0a6-4986-8bd2-1713d887245a tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8af80bd5-a0a6-4986-8bd2-1713d887245a tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8af80bd5-a0a6-4986-8bd2-1713d887245a tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8af80bd5-a0a6-4986-8bd2-1713d887245a tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73144) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-8af80bd5-a0a6-4986-8bd2-1713d887245a tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-41858907-a489-49e9-9b97-c631e3d4753c req-0fe002dd-5d40-48f6-885c-a27858aa4e74 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41858907-a489-49e9-9b97-c631e3d4753c req-0fe002dd-5d40-48f6-885c-a27858aa4e74 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41858907-a489-49e9-9b97-c631e3d4753c req-0fe002dd-5d40-48f6-885c-a27858aa4e74 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41858907-a489-49e9-9b97-c631e3d4753c req-0fe002dd-5d40-48f6-885c-a27858aa4e74 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-41858907-a489-49e9-9b97-c631e3d4753c req-0fe002dd-5d40-48f6-885c-a27858aa4e74 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:15 user nova-compute[73144]: WARNING nova.compute.manager [req-41858907-a489-49e9-9b97-c631e3d4753c req-0fe002dd-5d40-48f6-885c-a27858aa4e74 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state active and task_state powering-off.
Aug 14 21:51:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance destroyed successfully.
Aug 14 21:51:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8af80bd5-a0a6-4986-8bd2-1713d887245a tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8af80bd5-a0a6-4986-8bd2-1713d887245a tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.937s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cabea0f-bdb9-4f59-9bc0-e47d5f600877 req-7e22a128-bf76-4f86-97a5-66b4496e74da service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cabea0f-bdb9-4f59-9bc0-e47d5f600877 req-7e22a128-bf76-4f86-97a5-66b4496e74da service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cabea0f-bdb9-4f59-9bc0-e47d5f600877 req-7e22a128-bf76-4f86-97a5-66b4496e74da service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cabea0f-bdb9-4f59-9bc0-e47d5f600877 req-7e22a128-bf76-4f86-97a5-66b4496e74da service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cabea0f-bdb9-4f59-9bc0-e47d5f600877 req-7e22a128-bf76-4f86-97a5-66b4496e74da service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:17 user nova-compute[73144]: WARNING nova.compute.manager [req-4cabea0f-bdb9-4f59-9bc0-e47d5f600877 req-7e22a128-bf76-4f86-97a5-66b4496e74da service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state stopped and task_state None.
Aug 14 21:51:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:51:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Creating image(s)
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.219s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk 1073741824" returned: 0 in 0.060s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Cannot resize image /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Ensure instance console log exists: /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Start _get_guest_xml network_info=[{"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'e8c3cfcc-4e8e-4e0d-a254-b8d16d4739f2', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea802951-a15c-4dac-a693-4fe96ef3cc9f', 'attached_at': '', 'detached_at': '', 'volume_id': '4e5d8bd2-73d2-48b1-9b99-32dca17dfde4', 'serial': '4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:51:19 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 21:51:19 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:19 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:19 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:19 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[27972316-daea-4d6a-ac9f-ad0d8dde2467]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:51:19 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c789a-9d42-424c-85c4-83df1503bebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4] added
Aug 14 21:51:19 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.226s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52b549-d1ff-4a3a-a91b-3faf777ba597]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e95c3-c96d-454c-b560-c60aea78824d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njWFHoVS {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v njWFHoVS" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e7272-2faf-4837-9a0b-db2b9af4fe79]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'njWFHoVS'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db9d37-4554-4852-a4a6-d3c834f75e47]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[44154b66-5810-4d1b-aa7a-8cb1851d72ba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf564a-0e1e-424b-bbcb-d323491a33f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]
Aug 14 21:51:20 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.
Aug 14 21:51:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31fed38-b022-4025-95a3-6c1baf02de49]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b91e03d-fe73-4416-a31b-54653ddd65be]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:20 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:20 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.514s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2068044-0a06-4531-8e5b-cce6d4cc95a4]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Starting finish_revert_migration {{(pid=73144) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Start _get_guest_xml network_info=[{"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '154ce7e0-8ca8-4033-92c7-bc546f0d18cb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'abb6bbee-268b-45c6-b3da-49ecc86944c0', 'attached_at': '2023-08-14T21:51:20.000000', 'detached_at': '', 'volume_id': '3e42c18f-690a-4fd0-a365-b8e7bbbf4329', 'serial': '3e42c18f-690a-4fd0-a365-b8e7bbbf4329'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:51:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:51:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'vcpu_model' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:20 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:51:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049866.0490327, ea802951-a15c-4dac-a693-4fe96ef3cc9f => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:21 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] VM Stopped (Lifecycle Event)
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1ac77e9e-5af7-49d1-88d7-6f078482d01c None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.549s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== connect_volume: return (1551ms) {'type': 'block', 'scsi_wwn': '26265633434333161', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265633434333161', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.573s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:21 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:21 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6ab7de-b67f-4f0c-a931-02b891f9e918]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:51:21 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1593031860',display_name='tempest-ServerActionsTestOtherA-server-1475160519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1593031860',id=15,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqCumZ/fmgKOc7IfkPXpmLzqkGmsWcfXH/aHSLL63EIDPCYrbA7aV6dRIW5fpx+mmgIckHG/r4NRGJy6RPYUzNm64l35X06MrWUIA4QzuIwUkrvl1av/AdaNxdmexJsw==',key_name='tempest-keypair-1493275970',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-ffz2q41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=ea802951-a15c-4dac-a693-4fe96ef3cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:51:21 user nova-compute[73144]:   <uuid>ea802951-a15c-4dac-a693-4fe96ef3cc9f</uuid>
Aug 14 21:51:21 user nova-compute[73144]:   <name>instance-0000000f</name>
Aug 14 21:51:21 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:51:21 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:51:21 user nova-compute[73144]:   <metadata>
Aug 14 21:51:21 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:51:21 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:51:21 user nova-compute[73144]:       <nova:name>tempest-ServerActionsTestOtherA-server-1475160519</nova:name>
Aug 14 21:51:21 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:51:19</nova:creationTime>
Aug 14 21:51:21 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:51:21 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:51:21 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:51:21 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:51:21 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:51:21 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:51:21 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:51:21 user nova-compute[73144]:       <nova:owner>
Aug 14 21:51:21 user nova-compute[73144]:         <nova:user uuid="f236788f6a93453b893ddf6d4cf01c1c">tempest-ServerActionsTestOtherA-202206255-project-member</nova:user>
Aug 14 21:51:21 user nova-compute[73144]:         <nova:project uuid="fe2005f37baf4b1b99effc98fddd0fdc">tempest-ServerActionsTestOtherA-202206255</nova:project>
Aug 14 21:51:21 user nova-compute[73144]:       </nova:owner>
Aug 14 21:51:21 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:51:21 user nova-compute[73144]:       <nova:ports>
Aug 14 21:51:21 user nova-compute[73144]:         <nova:port uuid="6f7e06eb-2d48-431d-9305-24dc4801c99a">
Aug 14 21:51:21 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 21:51:21 user nova-compute[73144]:         </nova:port>
Aug 14 21:51:21 user nova-compute[73144]:       </nova:ports>
Aug 14 21:51:21 user nova-compute[73144]:     </nova:instance>
Aug 14 21:51:21 user nova-compute[73144]:   </metadata>
Aug 14 21:51:21 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:51:21 user nova-compute[73144]:     <system>
Aug 14 21:51:21 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:51:21 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:51:21 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:51:21 user nova-compute[73144]:       <entry name="serial">ea802951-a15c-4dac-a693-4fe96ef3cc9f</entry>
Aug 14 21:51:21 user nova-compute[73144]:       <entry name="uuid">ea802951-a15c-4dac-a693-4fe96ef3cc9f</entry>
Aug 14 21:51:21 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:51:21 user nova-compute[73144]:     </system>
Aug 14 21:51:21 user nova-compute[73144]:   </sysinfo>
Aug 14 21:51:21 user nova-compute[73144]:   <os>
Aug 14 21:51:21 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:51:21 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:51:21 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:51:21 user nova-compute[73144]:   </os>
Aug 14 21:51:21 user nova-compute[73144]:   <features>
Aug 14 21:51:21 user nova-compute[73144]:     <acpi/>
Aug 14 21:51:21 user nova-compute[73144]:     <apic/>
Aug 14 21:51:21 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:51:21 user nova-compute[73144]:   </features>
Aug 14 21:51:21 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:51:21 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:51:21 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:51:21 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:51:21 user nova-compute[73144]:   </clock>
Aug 14 21:51:21 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:51:21 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:51:21 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:51:21 user nova-compute[73144]:   </cpu>
Aug 14 21:51:21 user nova-compute[73144]:   <devices>
Aug 14 21:51:21 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:51:21 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:51:21 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk"/>
Aug 14 21:51:21 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:51:21 user nova-compute[73144]:     </disk>
Aug 14 21:51:21 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:51:21 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:21 user nova-compute[73144]:       <source dev="/dev/sdc"/>
Aug 14 21:51:21 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:51:21 user nova-compute[73144]:       <serial>4e5d8bd2-73d2-48b1-9b99-32dca17dfde4</serial>
Aug 14 21:51:21 user nova-compute[73144]:     </disk>
Aug 14 21:51:21 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:51:21 user nova-compute[73144]:       <mac address="fa:16:3e:4a:bd:e4"/>
Aug 14 21:51:21 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:51:21 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:51:21 user nova-compute[73144]:       <target dev="tap6f7e06eb-2d"/>
Aug 14 21:51:21 user nova-compute[73144]:     </interface>
Aug 14 21:51:21 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:51:21 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/console.log" append="off"/>
Aug 14 21:51:21 user nova-compute[73144]:     </serial>
Aug 14 21:51:21 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:51:21 user nova-compute[73144]:     <video>
Aug 14 21:51:21 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:51:21 user nova-compute[73144]:     </video>
Aug 14 21:51:21 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:51:21 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:51:21 user nova-compute[73144]:     </rng>
Aug 14 21:51:21 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:51:21 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:51:21 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:51:21 user nova-compute[73144]:     </memballoon>
Aug 14 21:51:21 user nova-compute[73144]:   </devices>
Aug 14 21:51:21 user nova-compute[73144]: </domain>
Aug 14 21:51:21 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1593031860',display_name='tempest-ServerActionsTestOtherA-server-1475160519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1593031860',id=15,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqCumZ/fmgKOc7IfkPXpmLzqkGmsWcfXH/aHSLL63EIDPCYrbA7aV6dRIW5fpx+mmgIckHG/r4NRGJy6RPYUzNm64l35X06MrWUIA4QzuIwUkrvl1av/AdaNxdmexJsw==',key_name='tempest-keypair-1493275970',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-ffz2q41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=ea802951-a15c-4dac-a693-4fe96ef3cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_vif [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f7e06eb-2d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f7e06eb-2d, col_values=(('external_ids', {'iface-id': '6f7e06eb-2d48-431d-9305-24dc4801c99a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:bd:e4', 'vm-uuid': 'ea802951-a15c-4dac-a693-4fe96ef3cc9f'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d2719-cc32-49c6-8350-8f424a1376a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329] added
Aug 14 21:51:21 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:21 user nova-compute[73144]: INFO os_vif [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d')
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaad4620-db32-4c8b-8b69-c5137e7f490c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e27c04f-e2e3-4f22-a79f-101d9b4ceecf]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTYcpkGm {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTYcpkGm" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ab3964-a07f-4bcd-9e8a-5da5307c2b3a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTYcpkGm'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No VIF found with MAC fa:16:3e:4a:bd:e4, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25c557b-2461-4af9-a320-efe7dcc43fcb]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da14e3-ecb5-4b12-9aa7-0f86aee5054e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3dd185-a70e-4668-871a-e25540c9a0d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]
Aug 14 21:51:21 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.
Aug 14 21:51:21 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd59b74-0563-4a68-8aee-a6bcf303f774]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6d959-78ae-4178-a5b7-fcc8addbea62]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:21 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c2d50c-39d4-4d66-87ae-2a23be932fa5]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:51:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049867.4928455, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:22 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Stopped (Lifecycle Event)
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-85e290ab-01cf-4c00-8a22-d104fda89f7a None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== connect_volume: return (1885ms) {'type': 'block', 'scsi_wwn': '26237626263303761', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237626263303761', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:51:22 user nova-compute[73144]:   <uuid>abb6bbee-268b-45c6-b3da-49ecc86944c0</uuid>
Aug 14 21:51:22 user nova-compute[73144]:   <name>instance-00000005</name>
Aug 14 21:51:22 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:51:22 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:51:22 user nova-compute[73144]:   <metadata>
Aug 14 21:51:22 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:51:22 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:51:22 user nova-compute[73144]:       <nova:name>tempest-ServerActionsTestOtherB-server-504781444</nova:name>
Aug 14 21:51:22 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:51:20</nova:creationTime>
Aug 14 21:51:22 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:51:22 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:51:22 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:51:22 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:51:22 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:51:22 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:51:22 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:51:22 user nova-compute[73144]:       <nova:owner>
Aug 14 21:51:22 user nova-compute[73144]:         <nova:user uuid="f24af35347484e5982207ed21f62bc2a">tempest-ServerActionsTestOtherB-679953584-project-member</nova:user>
Aug 14 21:51:22 user nova-compute[73144]:         <nova:project uuid="1c3eaba4f7824769adb0e2a2a28f3924">tempest-ServerActionsTestOtherB-679953584</nova:project>
Aug 14 21:51:22 user nova-compute[73144]:       </nova:owner>
Aug 14 21:51:22 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:51:22 user nova-compute[73144]:       <nova:ports>
Aug 14 21:51:22 user nova-compute[73144]:         <nova:port uuid="758cbe79-b4b9-40b7-93a4-37b07664efb4">
Aug 14 21:51:22 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 21:51:22 user nova-compute[73144]:         </nova:port>
Aug 14 21:51:22 user nova-compute[73144]:       </nova:ports>
Aug 14 21:51:22 user nova-compute[73144]:     </nova:instance>
Aug 14 21:51:22 user nova-compute[73144]:   </metadata>
Aug 14 21:51:22 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:51:22 user nova-compute[73144]:     <system>
Aug 14 21:51:22 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:51:22 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:51:22 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:51:22 user nova-compute[73144]:       <entry name="serial">abb6bbee-268b-45c6-b3da-49ecc86944c0</entry>
Aug 14 21:51:22 user nova-compute[73144]:       <entry name="uuid">abb6bbee-268b-45c6-b3da-49ecc86944c0</entry>
Aug 14 21:51:22 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:51:22 user nova-compute[73144]:     </system>
Aug 14 21:51:22 user nova-compute[73144]:   </sysinfo>
Aug 14 21:51:22 user nova-compute[73144]:   <os>
Aug 14 21:51:22 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:51:22 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:51:22 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:51:22 user nova-compute[73144]:   </os>
Aug 14 21:51:22 user nova-compute[73144]:   <features>
Aug 14 21:51:22 user nova-compute[73144]:     <acpi/>
Aug 14 21:51:22 user nova-compute[73144]:     <apic/>
Aug 14 21:51:22 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:51:22 user nova-compute[73144]:   </features>
Aug 14 21:51:22 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:51:22 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:51:22 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:51:22 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:51:22 user nova-compute[73144]:   </clock>
Aug 14 21:51:22 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:51:22 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:51:22 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:51:22 user nova-compute[73144]:   </cpu>
Aug 14 21:51:22 user nova-compute[73144]:   <devices>
Aug 14 21:51:22 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:51:22 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:51:22 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk"/>
Aug 14 21:51:22 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:51:22 user nova-compute[73144]:     </disk>
Aug 14 21:51:22 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:51:22 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:22 user nova-compute[73144]:       <source dev="/dev/sdd"/>
Aug 14 21:51:22 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:51:22 user nova-compute[73144]:       <serial>3e42c18f-690a-4fd0-a365-b8e7bbbf4329</serial>
Aug 14 21:51:22 user nova-compute[73144]:     </disk>
Aug 14 21:51:22 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:51:22 user nova-compute[73144]:       <mac address="fa:16:3e:74:a7:97"/>
Aug 14 21:51:22 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:51:22 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:51:22 user nova-compute[73144]:       <target dev="tap758cbe79-b4"/>
Aug 14 21:51:22 user nova-compute[73144]:     </interface>
Aug 14 21:51:22 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:51:22 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/console.log" append="off"/>
Aug 14 21:51:22 user nova-compute[73144]:     </serial>
Aug 14 21:51:22 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:51:22 user nova-compute[73144]:     <video>
Aug 14 21:51:22 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:51:22 user nova-compute[73144]:     </video>
Aug 14 21:51:22 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:51:22 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:51:22 user nova-compute[73144]:     </rng>
Aug 14 21:51:22 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:51:22 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:51:22 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:51:22 user nova-compute[73144]:     </memballoon>
Aug 14 21:51:22 user nova-compute[73144]:   </devices>
Aug 14 21:51:22 user nova-compute[73144]: </domain>
Aug 14 21:51:22 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG os_vif [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap758cbe79-b4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap758cbe79-b4, col_values=(('external_ids', {'iface-id': '758cbe79-b4b9-40b7-93a4-37b07664efb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:a7:97', 'vm-uuid': 'abb6bbee-268b-45c6-b3da-49ecc86944c0'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: INFO os_vif [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4')
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-9b53202c-8c06-424f-922a-fcd3f6a67bf2 req-e7eea769-3209-42c1-9b07-38980145c3fd service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9b53202c-8c06-424f-922a-fcd3f6a67bf2 req-e7eea769-3209-42c1-9b07-38980145c3fd service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9b53202c-8c06-424f-922a-fcd3f6a67bf2 req-e7eea769-3209-42c1-9b07-38980145c3fd service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9b53202c-8c06-424f-922a-fcd3f6a67bf2 req-e7eea769-3209-42c1-9b07-38980145c3fd service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-9b53202c-8c06-424f-922a-fcd3f6a67bf2 req-e7eea769-3209-42c1-9b07-38980145c3fd service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:22 user nova-compute[73144]: WARNING nova.compute.manager [req-9b53202c-8c06-424f-922a-fcd3f6a67bf2 req-e7eea769-3209-42c1-9b07-38980145c3fd service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received unexpected event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with vm_state active and task_state rebuild_spawning.
Aug 14 21:51:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:25 user nova-compute[73144]: WARNING nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received unexpected event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with vm_state active and task_state rebuild_spawning.
Aug 14 21:51:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:25 user nova-compute[73144]: WARNING nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state resized and task_state resize_reverting.
Aug 14 21:51:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] No waiting events found dispatching network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:25 user nova-compute[73144]: WARNING nova.compute.manager [req-81dee263-b1a3-4192-b81c-a245d6d45890 req-d4456891-401b-4fb6-8018-e27fb2c678bf service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received unexpected event network-vif-plugged-758cbe79-b4b9-40b7-93a4-37b07664efb4 for instance with vm_state resized and task_state resize_reverting.
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:25 user nova-compute[73144]: INFO nova.compute.manager [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Terminating instance
Aug 14 21:51:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049886.2617283, ea802951-a15c-4dac-a693-4fe96ef3cc9f => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] VM Resumed (Lifecycle Event)
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance spawned successfully.
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Instance destroyed successfully.
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lazy-loading 'resources' on Instance uuid 4583cc14-41a8-46b7-85d5-440efba5ec4f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049886.2629695, ea802951-a15c-4dac-a693-4fe96ef3cc9f => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] VM Started (Lifecycle Event)
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1135813681',display_name='tempest-VolumesAdminNegativeTest-server-1135813681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1135813681',id=7,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMn7xEfatAyEc5nZ4EwHUn3JLvQQ+5NlAKyjrS49au1PMEou6puK5b5erpNT60rKBOaAK5Gotr4BDHMPfolu0IXjfGfDIhJ4Zd3lHVv3yMXwPBwN4T007SoJ4fXHthOKA==',key_name='tempest-keypair-1784913599',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ea8cc08442546c29ea4a251995ea832',ramdisk_id='',reservation_id='r-uuklczhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-177118256',owner_user_name='tempest-VolumesAdminNegativeTest-177118256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='894a50b95060455fb7702b1216f2adf4',uuid=4583cc14-41a8-46b7-85d5-440efba5ec4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converting VIF {"id": "1850f048-e688-4549-94c2-99033fbe1eae", "address": "fa:16:3e:60:39:59", "network": {"id": "2fdaba97-9912-4dde-a58b-6b731ec9ddd5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-194425278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea8cc08442546c29ea4a251995ea832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1850f048-e6", "ovs_interfaceid": "1850f048-e688-4549-94c2-99033fbe1eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:39:59,bridge_name='br-int',has_traffic_filtering=True,id=1850f048-e688-4549-94c2-99033fbe1eae,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1850f048-e6') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG os_vif [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:39:59,bridge_name='br-int',has_traffic_filtering=True,id=1850f048-e688-4549-94c2-99033fbe1eae,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1850f048-e6') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1850f048-e6, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:26 user nova-compute[73144]: INFO os_vif [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:39:59,bridge_name='br-int',has_traffic_filtering=True,id=1850f048-e688-4549-94c2-99033fbe1eae,network=Network(2fdaba97-9912-4dde-a58b-6b731ec9ddd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1850f048-e6')
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Deleting instance files /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f_del
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Deletion of /opt/stack/data/nova/instances/4583cc14-41a8-46b7-85d5-440efba5ec4f_del complete
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 21:51:26 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73144) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577ef139-4e96-4df4-8d3b-162164d87a6e tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.098s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049886.6749458, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Resumed (Lifecycle Event)
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance running successfully.
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] finish_revert_migration finished successfully. {{(pid=73144) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049886.6771088, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Started (Lifecycle Event)
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 21:51:26 user nova-compute[73144]: INFO nova.compute.manager [None req-bf44a30d-8f08-4092-b45e-f8ec09076633 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance to original state: 'active'
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-vif-unplugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] No waiting events found dispatching network-vif-unplugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-vif-unplugged-1850f048-e688-4549-94c2-99033fbe1eae for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] Acquiring lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] No waiting events found dispatching network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:27 user nova-compute[73144]: WARNING nova.compute.manager [req-b292c2e7-321e-45dc-ac0d-5713122215af req-167bfce4-61d7-4c43-83b7-b1230ca671b1 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received unexpected event network-vif-plugged-1850f048-e688-4549-94c2-99033fbe1eae for instance with vm_state active and task_state deleting.
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:27 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Took 0.80 seconds to deallocate network for instance.
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:27 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Deleted allocations for instance 4583cc14-41a8-46b7-85d5-440efba5ec4f
Aug 14 21:51:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0c6bbc4b-f77c-4d76-9bfd-a2ca8c305671 tempest-VolumesAdminNegativeTest-177118256 tempest-VolumesAdminNegativeTest-177118256-project-member] Lock "4583cc14-41a8-46b7-85d5-440efba5ec4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.418s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid b38d8d04-d91a-49d3-9350-e44d2ba576cf {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 6f7f7181-df25-4e9a-b990-251cabf0129c {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 3e6cc55c-3284-44ff-85af-642f666910da {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "3e6cc55c-3284-44ff-85af-642f666910da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ef7cd461-517e-458c-a22a-d226daf54347" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:28 user nova-compute[73144]: WARNING oslo_messaging._drivers.amqpdriver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ef7cd461-517e-458c-a22a-d226daf54347" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "3e6cc55c-3284-44ff-85af-642f666910da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-189ec97e-7f14-4a34-88c0-e920eb8f5914 req-833a0f9e-a571-4a39-b9cb-9bedb01f3691 service nova] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Received event network-vif-deleted-1850f048-e688-4549-94c2-99033fbe1eae {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:30 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049875.9549358, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:30 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Stopped (Lifecycle Event)
Aug 14 21:51:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-78d1ecd4-35cf-4825-848c-f1016d37f6ac None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-78d1ecd4-35cf-4825-848c-f1016d37f6ac None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:32 user nova-compute[73144]: INFO nova.compute.manager [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Detaching volume 5a5bdd80-3b54-4849-9e4a-f1bbf3fff676
Aug 14 21:51:32 user nova-compute[73144]: INFO nova.virt.block_device [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Attempting to driver detach volume 5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 from mountpoint /dev/vdb
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Attempting to detach device vdb from instance ae3ee52c-0811-4c67-a43e-736e02c5511d from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:51:32 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:32 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:51:32 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:51:32 user nova-compute[73144]:   <serial>5a5bdd80-3b54-4849-9e4a-f1bbf3fff676</serial>
Aug 14 21:51:32 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:51:32 user nova-compute[73144]: </disk>
Aug 14 21:51:32 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:51:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Successfully detached device vdb from instance ae3ee52c-0811-4c67-a43e-736e02c5511d from the persistent domain config.
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae3ee52c-0811-4c67-a43e-736e02c5511d from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:51:32 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:51:32 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:51:32 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:51:32 user nova-compute[73144]:   <serial>5a5bdd80-3b54-4849-9e4a-f1bbf3fff676</serial>
Aug 14 21:51:32 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:51:32 user nova-compute[73144]: </disk>
Aug 14 21:51:32 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049892.5074854, ae3ee52c-0811-4c67-a43e-736e02c5511d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:51:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Successfully detached device vdb from instance ae3ee52c-0811-4c67-a43e-736e02c5511d from the live domain config.
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCrOxIuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:51:32 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45272f0-a2c1-44a2-acc5-8af164bdcdab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d768ed-8fae-4661-a125-1cf4fcf8c4aa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:32 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:32 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:32 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 (non-flash)
Aug 14 21:51:32 user nova-compute[73144]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:51:32 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:51:32 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586ba0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[86204b45-b442-4fd9-b74a-9f76c09867d2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea85d45-8db8-4ed0-b4bf-95335f911f62]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a485a4ff-09b1-4e41-82ea-74f6a8afb882]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3f66ac-66de-450d-8a14-31624cf64b95]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92a850-dfaf-4e64-bb3e-5467dacf18af]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b4bd5-6858-4831-b0bc-4bac4ff28b6e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260]
Aug 14 21:51:32 user nova-compute[73144]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676, portal: 172.16.0.220,3260] successful.
Aug 14 21:51:32 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5bdd80-3b54-4849-9e4a-f1bbf3fff676 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f5d78-106c-4365-b083-97e0006d4cb0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] <== disconnect_volume: return (421ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:51:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:51:33 user nova-compute[73144]: DEBUG nova.objects.instance [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'flavor' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-28261eed-3c34-4343-89df-0cc6d63b1da3 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:41 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049886.3088348, 4583cc14-41a8-46b7-85d5-440efba5ec4f => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:41 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] VM Stopped (Lifecycle Event)
Aug 14 21:51:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e4f6649c-2d17-40c4-8721-e1aa63d1eb9e None None] [instance: 4583cc14-41a8-46b7-85d5-440efba5ec4f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:51:51 user nova-compute[73144]: INFO nova.compute.claims [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Claim successful on node user
Aug 14 21:51:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:51:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:51:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.policy [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '597588abcb1a4963a536b2b078ceef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b004e49247a041b7b00500416a625ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:51:52 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Creating image(s)
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "/opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk 1073741824" returned: 0 in 0.051s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.167s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Cannot resize image /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'migration_context' on Instance uuid 97776072-7d34-4549-8f2e-bc01db5cba92 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Ensure instance console log exists: /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Successfully created port: a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Successfully updated port: a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquired lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-changed-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Refreshing instance network info cache due to event network-changed-a01c90a6-af4f-47c5-98ac-b2bb00fa2006. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] Acquiring lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:51:53 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updating instance_info_cache with network_info: [{"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Releasing lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Instance network_info: |[{"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] Acquired lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Refreshing network info cache for port a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Start _get_guest_xml network_info=[{"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:51:54 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:51:54 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-406134668',display_name='tempest-AttachVolumeNegativeTest-server-406134668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-406134668',id=22,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrgLs7eC0Twgf8ZwTwVL4HjpYKVaSX62FXlcahC4i3TaFZhU5pEI5tnMziJJ+FeUR5HhKVIkKYqoZsbEYvvLMTu0nK/4ICW2MkwZ/qHSZd3CkfztsBfDXdrYWffcON2Ig==',key_name='tempest-keypair-1210752663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-ff4y0ecw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=97776072-7d34-4549-8f2e-bc01db5cba92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:75:2c,bridge_name='br-int',has_traffic_filtering=True,id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa01c90a6-af') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'pci_devices' on Instance uuid 97776072-7d34-4549-8f2e-bc01db5cba92 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:51:54 user nova-compute[73144]:   <uuid>97776072-7d34-4549-8f2e-bc01db5cba92</uuid>
Aug 14 21:51:54 user nova-compute[73144]:   <name>instance-00000016</name>
Aug 14 21:51:54 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:51:54 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:51:54 user nova-compute[73144]:   <metadata>
Aug 14 21:51:54 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:51:54 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:51:54 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeNegativeTest-server-406134668</nova:name>
Aug 14 21:51:54 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:51:54</nova:creationTime>
Aug 14 21:51:54 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:51:54 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:51:54 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:51:54 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:51:54 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:51:54 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:51:54 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:51:54 user nova-compute[73144]:       <nova:owner>
Aug 14 21:51:54 user nova-compute[73144]:         <nova:user uuid="597588abcb1a4963a536b2b078ceef23">tempest-AttachVolumeNegativeTest-1600069366-project-member</nova:user>
Aug 14 21:51:54 user nova-compute[73144]:         <nova:project uuid="b004e49247a041b7b00500416a625ca7">tempest-AttachVolumeNegativeTest-1600069366</nova:project>
Aug 14 21:51:54 user nova-compute[73144]:       </nova:owner>
Aug 14 21:51:54 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:51:54 user nova-compute[73144]:       <nova:ports>
Aug 14 21:51:54 user nova-compute[73144]:         <nova:port uuid="a01c90a6-af4f-47c5-98ac-b2bb00fa2006">
Aug 14 21:51:54 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 21:51:54 user nova-compute[73144]:         </nova:port>
Aug 14 21:51:54 user nova-compute[73144]:       </nova:ports>
Aug 14 21:51:54 user nova-compute[73144]:     </nova:instance>
Aug 14 21:51:54 user nova-compute[73144]:   </metadata>
Aug 14 21:51:54 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:51:54 user nova-compute[73144]:     <system>
Aug 14 21:51:54 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:51:54 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:51:54 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:51:54 user nova-compute[73144]:       <entry name="serial">97776072-7d34-4549-8f2e-bc01db5cba92</entry>
Aug 14 21:51:54 user nova-compute[73144]:       <entry name="uuid">97776072-7d34-4549-8f2e-bc01db5cba92</entry>
Aug 14 21:51:54 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:51:54 user nova-compute[73144]:     </system>
Aug 14 21:51:54 user nova-compute[73144]:   </sysinfo>
Aug 14 21:51:54 user nova-compute[73144]:   <os>
Aug 14 21:51:54 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:51:54 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:51:54 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:51:54 user nova-compute[73144]:   </os>
Aug 14 21:51:54 user nova-compute[73144]:   <features>
Aug 14 21:51:54 user nova-compute[73144]:     <acpi/>
Aug 14 21:51:54 user nova-compute[73144]:     <apic/>
Aug 14 21:51:54 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:51:54 user nova-compute[73144]:   </features>
Aug 14 21:51:54 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:51:54 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:51:54 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:51:54 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:51:54 user nova-compute[73144]:   </clock>
Aug 14 21:51:54 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:51:54 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:51:54 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:51:54 user nova-compute[73144]:   </cpu>
Aug 14 21:51:54 user nova-compute[73144]:   <devices>
Aug 14 21:51:54 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:51:54 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:51:54 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk"/>
Aug 14 21:51:54 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:51:54 user nova-compute[73144]:     </disk>
Aug 14 21:51:54 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:51:54 user nova-compute[73144]:       <mac address="fa:16:3e:3a:75:2c"/>
Aug 14 21:51:54 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:51:54 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:51:54 user nova-compute[73144]:       <target dev="tapa01c90a6-af"/>
Aug 14 21:51:54 user nova-compute[73144]:     </interface>
Aug 14 21:51:54 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:51:54 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/console.log" append="off"/>
Aug 14 21:51:54 user nova-compute[73144]:     </serial>
Aug 14 21:51:54 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:51:54 user nova-compute[73144]:     <video>
Aug 14 21:51:54 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:51:54 user nova-compute[73144]:     </video>
Aug 14 21:51:54 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:51:54 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:51:54 user nova-compute[73144]:     </rng>
Aug 14 21:51:54 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:51:54 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:51:54 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:51:54 user nova-compute[73144]:     </memballoon>
Aug 14 21:51:54 user nova-compute[73144]:   </devices>
Aug 14 21:51:54 user nova-compute[73144]: </domain>
Aug 14 21:51:54 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-406134668',display_name='tempest-AttachVolumeNegativeTest-server-406134668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-406134668',id=22,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrgLs7eC0Twgf8ZwTwVL4HjpYKVaSX62FXlcahC4i3TaFZhU5pEI5tnMziJJ+FeUR5HhKVIkKYqoZsbEYvvLMTu0nK/4ICW2MkwZ/qHSZd3CkfztsBfDXdrYWffcON2Ig==',key_name='tempest-keypair-1210752663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-ff4y0ecw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=97776072-7d34-4549-8f2e-bc01db5cba92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:75:2c,bridge_name='br-int',has_traffic_filtering=True,id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa01c90a6-af') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG os_vif [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:75:2c,bridge_name='br-int',has_traffic_filtering=True,id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa01c90a6-af') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa01c90a6-af, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa01c90a6-af, col_values=(('external_ids', {'iface-id': 'a01c90a6-af4f-47c5-98ac-b2bb00fa2006', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:75:2c', 'vm-uuid': '97776072-7d34-4549-8f2e-bc01db5cba92'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:54 user nova-compute[73144]: INFO os_vif [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:75:2c,bridge_name='br-int',has_traffic_filtering=True,id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa01c90a6-af')
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No VIF found with MAC fa:16:3e:3a:75:2c, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updated VIF entry in instance network info cache for port a01c90a6-af4f-47c5-98ac-b2bb00fa2006. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updating instance_info_cache with network_info: [{"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:51:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3c399033-5c45-4b8d-aa8c-d3a24fdc6f9e req-2dff490d-ea04-40c4-a56d-e8e6af919180 service nova] Releasing lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-e5b499dd-47c3-4920-a44b-4e6bfe6c52f3 req-103bf21d-9dd6-419a-aa3e-f469448fef2d service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e5b499dd-47c3-4920-a44b-4e6bfe6c52f3 req-103bf21d-9dd6-419a-aa3e-f469448fef2d service nova] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e5b499dd-47c3-4920-a44b-4e6bfe6c52f3 req-103bf21d-9dd6-419a-aa3e-f469448fef2d service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e5b499dd-47c3-4920-a44b-4e6bfe6c52f3 req-103bf21d-9dd6-419a-aa3e-f469448fef2d service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-e5b499dd-47c3-4920-a44b-4e6bfe6c52f3 req-103bf21d-9dd6-419a-aa3e-f469448fef2d service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] No waiting events found dispatching network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:55 user nova-compute[73144]: WARNING nova.compute.manager [req-e5b499dd-47c3-4920-a44b-4e6bfe6c52f3 req-103bf21d-9dd6-419a-aa3e-f469448fef2d service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received unexpected event network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 for instance with vm_state building and task_state spawning.
Aug 14 21:51:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:56 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049917.5205984, 97776072-7d34-4549-8f2e-bc01db5cba92 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] VM Resumed (Lifecycle Event)
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:51:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Instance spawned successfully.
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:51:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049917.5220044, 97776072-7d34-4549-8f2e-bc01db5cba92 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:51:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] VM Started (Lifecycle Event)
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:51:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:51:57 user nova-compute[73144]: INFO nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:51:57 user nova-compute[73144]: INFO nova.compute.manager [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Took 6.37 seconds to build instance.
Aug 14 21:51:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2534fb3b-8091-45af-8059-bf041dec5c4e tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.459s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-0b0c54d9-b560-411f-ab38-f8c8f40591c0 req-aad89154-bf28-45a1-b075-159836f407c8 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0b0c54d9-b560-411f-ab38-f8c8f40591c0 req-aad89154-bf28-45a1-b075-159836f407c8 service nova] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0b0c54d9-b560-411f-ab38-f8c8f40591c0 req-aad89154-bf28-45a1-b075-159836f407c8 service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0b0c54d9-b560-411f-ab38-f8c8f40591c0 req-aad89154-bf28-45a1-b075-159836f407c8 service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:51:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-0b0c54d9-b560-411f-ab38-f8c8f40591c0 req-aad89154-bf28-45a1-b075-159836f407c8 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] No waiting events found dispatching network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:51:57 user nova-compute[73144]: WARNING nova.compute.manager [req-0b0c54d9-b560-411f-ab38-f8c8f40591c0 req-aad89154-bf28-45a1-b075-159836f407c8 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received unexpected event network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 for instance with vm_state active and task_state None.
Aug 14 21:51:58 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:51:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:51:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-changed-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Refreshing instance network info cache due to event network-changed-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] Acquiring lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] Acquired lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG nova.network.neutron [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Refreshing network info cache for port db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:52:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG nova.network.neutron [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updated VIF entry in instance network info cache for port db1673eb-0d2f-4c7d-ab31-2d3b2aac388a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG nova.network.neutron [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updating instance_info_cache with network_info: [{"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-af054ab0-2f2b-4f14-81f7-8b373bc94617 req-e93db084-7113-46c9-8866-be8ec860c2e0 service nova] Releasing lock "refresh_cache-bd2d7d21-f497-4a08-8c70-946dbc83d9db" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG nova.objects.instance [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lazy-loading 'flavor' on Instance uuid bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:04 user nova-compute[73144]: INFO nova.compute.manager [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Attaching volume 2c428a2b-0273-40dd-935d-30a974852b92 to /dev/sdc
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG os_brick.utils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654b70e-2a6a-40e0-a5c5-8da275076248]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d654ea8e-3f24-46f5-ae45-b44a55bd2820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[026f4c4d-4a17-41ba-bed4-bc7dd0e036b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[177dfe59-c0b6-4b15-90ab-aa4f7e6231ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:52:04 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:52:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[873e4fa8-f427-4a44-8147-6d9cad399de9]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG os_brick.utils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:52:04 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updating existing volume attachment record: 49cd4cc5-4f9a-4dde-b02d-aad04a40ae9f {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:52:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:06 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:52:06 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=6935MB free_disk=25.288047790527344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ae3ee52c-0811-4c67-a43e-736e02c5511d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ea802951-a15c-4dac-a693-4fe96ef3cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance bd2d7d21-f497-4a08-8c70-946dbc83d9db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3e6cc55c-3284-44ff-85af-642f666910da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 85862011-79d3-488f-885c-e4e907d8ed2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 97776072-7d34-4549-8f2e-bc01db5cba92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:52:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:52:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:52:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:52:08 user nova-compute[73144]: INFO nova.compute.manager [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] instance snapshotting
Aug 14 21:52:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Beginning live snapshot process
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl5k6turr/8c309fcf200b41dda4394904fb46c469.delta 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl5k6turr/8c309fcf200b41dda4394904fb46c469.delta 1073741824" returned: 0 in 0.053s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 21:52:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:52:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:52:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 21:52:10 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:52:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl5k6turr/8c309fcf200b41dda4394904fb46c469.delta /opt/stack/data/nova/instances/snapshots/tmpl5k6turr/8c309fcf200b41dda4394904fb46c469 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl5k6turr/8c309fcf200b41dda4394904fb46c469.delta /opt/stack/data/nova/instances/snapshots/tmpl5k6turr/8c309fcf200b41dda4394904fb46c469" returned: 0 in 0.524s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Snapshot extracted, beginning image upload
Aug 14 21:52:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Snapshot image upload complete
Aug 14 21:52:13 user nova-compute[73144]: INFO nova.compute.manager [None req-58590504-c9e7-40c1-b80c-6d4ffff08af2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Took 5.10 seconds to snapshot the instance on the hypervisor.
Aug 14 21:52:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIHRDbcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:52:13 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:52:13 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:52:13 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6babcb-0e1b-42c3-b204-b99ce0c313d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:52:13 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84541c9-22e3-4b1e-a575-4c3924c5b914]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92] added
Aug 14 21:52:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[144bf4b1-25f3-4e88-ab43-d6c1022b5ccc]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1f598-d5e0-434c-a468-d5729bb4e3d2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIHRDbcP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIHRDbcP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c941b26f-8de6-482b-b200-33edb27d4167]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qIHRDbcP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[311de2f6-0518-4d45-8ba9-680880e44551]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa13c35-18c0-428d-a5e8-a18f56141d3e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadb792f-fc1a-4941-a0e1-0b594a707bf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260]
Aug 14 21:52:14 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260] successful.
Aug 14 21:52:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af9b0f0-1265-4c5a-ad58-46fda339ae0c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[59103183-2809-410b-8a61-74de83e8cdd1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 (non-flash)
Aug 14 21:52:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eae55e3-5c18-4082-a156-99b8c109f07d]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:52:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIHRDbcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23366346131303361', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366346131303361', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lazy-loading 'flavor' on Instance uuid bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:52:15 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:52:15 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:52:15 user nova-compute[73144]:   <target dev="sdc" bus="scsi"/>
Aug 14 21:52:15 user nova-compute[73144]:   <serial>2c428a2b-0273-40dd-935d-30a974852b92</serial>
Aug 14 21:52:15 user nova-compute[73144]:   <address type="drive" controller="0" unit="2"/>
Aug 14 21:52:15 user nova-compute[73144]: </disk>
Aug 14 21:52:15 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] No BDM found with device name sda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] No VIF found with MAC fa:16:3e:95:d5:8a, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:52:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-fbfd44b9-5ec0-44f3-afd3-05d2815ceb6a tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.153s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "3e6cc55c-3284-44ff-85af-642f666910da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:16 user nova-compute[73144]: INFO nova.compute.manager [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Terminating instance
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-171281a3-97d5-48c1-83b2-457f0496252a req-fbe5c8b6-ab25-485a-8836-57e182795432 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received event network-vif-unplugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-171281a3-97d5-48c1-83b2-457f0496252a req-fbe5c8b6-ab25-485a-8836-57e182795432 service nova] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-171281a3-97d5-48c1-83b2-457f0496252a req-fbe5c8b6-ab25-485a-8836-57e182795432 service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-171281a3-97d5-48c1-83b2-457f0496252a req-fbe5c8b6-ab25-485a-8836-57e182795432 service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-171281a3-97d5-48c1-83b2-457f0496252a req-fbe5c8b6-ab25-485a-8836-57e182795432 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] No waiting events found dispatching network-vif-unplugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-171281a3-97d5-48c1-83b2-457f0496252a req-fbe5c8b6-ab25-485a-8836-57e182795432 service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received event network-vif-unplugged-631d9e61-e227-4d9d-a853-640411db0d46 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:52:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Instance destroyed successfully.
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lazy-loading 'resources' on Instance uuid 3e6cc55c-3284-44ff-85af-642f666910da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-693988685',display_name='tempest-VolumesActionsTest-instance-693988685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-693988685',id=18,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:50:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be14e5de45434b098f04c1542b3fb835',ramdisk_id='',reservation_id='r-x0opk80u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-491668790',owner_user_name='tempest-VolumesActionsTest-491668790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:50:34Z,user_data=None,user_id='86a7e438722d4fe2b70c0546c64093d9',uuid=3e6cc55c-3284-44ff-85af-642f666910da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converting VIF {"id": "631d9e61-e227-4d9d-a853-640411db0d46", "address": "fa:16:3e:16:b4:af", "network": {"id": "8a563ff3-91fa-4b02-a87d-1108cc60c80d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2116025964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be14e5de45434b098f04c1542b3fb835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631d9e61-e2", "ovs_interfaceid": "631d9e61-e227-4d9d-a853-640411db0d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:af,bridge_name='br-int',has_traffic_filtering=True,id=631d9e61-e227-4d9d-a853-640411db0d46,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631d9e61-e2') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG os_vif [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:af,bridge_name='br-int',has_traffic_filtering=True,id=631d9e61-e227-4d9d-a853-640411db0d46,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631d9e61-e2') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap631d9e61-e2, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:16 user nova-compute[73144]: INFO os_vif [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:af,bridge_name='br-int',has_traffic_filtering=True,id=631d9e61-e227-4d9d-a853-640411db0d46,network=Network(8a563ff3-91fa-4b02-a87d-1108cc60c80d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631d9e61-e2')
Aug 14 21:52:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Deleting instance files /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da_del
Aug 14 21:52:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Deletion of /opt/stack/data/nova/instances/3e6cc55c-3284-44ff-85af-642f666910da_del complete
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:16 user nova-compute[73144]: INFO nova.compute.manager [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Detaching volume 2c428a2b-0273-40dd-935d-30a974852b92
Aug 14 21:52:16 user nova-compute[73144]: INFO nova.compute.manager [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 14 21:52:16 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:52:16 user nova-compute[73144]: INFO nova.virt.block_device [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Attempting to driver detach volume 2c428a2b-0273-40dd-935d-30a974852b92 from mountpoint /dev/sdc
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Attempting to detach device sdc from instance bd2d7d21-f497-4a08-8c70-946dbc83d9db from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:52:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:52:16 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:52:16 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:52:16 user nova-compute[73144]:   <target dev="sdc" bus="scsi"/>
Aug 14 21:52:16 user nova-compute[73144]:   <serial>2c428a2b-0273-40dd-935d-30a974852b92</serial>
Aug 14 21:52:16 user nova-compute[73144]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 21:52:16 user nova-compute[73144]: </disk>
Aug 14 21:52:16 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:52:17 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Successfully detached device sdc from instance bd2d7d21-f497-4a08-8c70-946dbc83d9db from the persistent domain config.
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance bd2d7d21-f497-4a08-8c70-946dbc83d9db from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:52:17 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:52:17 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:52:17 user nova-compute[73144]:   <target dev="sdc" bus="scsi"/>
Aug 14 21:52:17 user nova-compute[73144]:   <serial>2c428a2b-0273-40dd-935d-30a974852b92</serial>
Aug 14 21:52:17 user nova-compute[73144]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 21:52:17 user nova-compute[73144]: </disk>
Aug 14 21:52:17 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049937.4103186, bd2d7d21-f497-4a08-8c70-946dbc83d9db => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:52:17 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Successfully detached device sdc from instance bd2d7d21-f497-4a08-8c70-946dbc83d9db from the live domain config.
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIHRDbcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:52:17 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e908f7-f3f9-407d-a98a-7000c876eeac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Took 0.57 seconds to deallocate network for instance.
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[923a7406-1dc2-4fae-b319-fe5bc0b6a3b0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:17 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:17 user nova-compute[73144]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 (non-flash)
Aug 14 21:52:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:17 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:17 user nova-compute[73144]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 (non-flash)
Aug 14 21:52:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586abc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4827ab1e-bcd2-4ac0-b1b9-514b0833a288]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f789b2e3-3603-4571-8cc1-3763cac62172]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941379d-fa02-47e3-908f-82349a99bd81]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3514d04-d97b-43ce-809f-266dd94fcf73]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[291be369-f5c6-4094-954a-bcda1af3335d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ccdcc4-0b54-4701-8da5-cd17d078b94b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260]
Aug 14 21:52:17 user nova-compute[73144]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92, portal: 172.16.0.220,3260] successful.
Aug 14 21:52:17 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c428a2b-0273-40dd-935d-30a974852b92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b207c0-f82e-4c8b-8786-67a88996c153]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] <== disconnect_volume: return (273ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:52:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:17 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Deleted allocations for instance 3e6cc55c-3284-44ff-85af-642f666910da
Aug 14 21:52:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e98e55e4-2751-4659-b187-81c20ab7593e tempest-VolumesActionsTest-491668790 tempest-VolumesActionsTest-491668790-project-member] Lock "3e6cc55c-3284-44ff-85af-642f666910da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:18 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lazy-loading 'flavor' on Instance uuid bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6940f74-ea3c-453f-9a9c-308c56799ece tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-56af9de8-2837-463c-839d-8763690326d6 req-ddaae6bc-25c6-454f-b133-7091f3ad1d0d service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received event network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56af9de8-2837-463c-839d-8763690326d6 req-ddaae6bc-25c6-454f-b133-7091f3ad1d0d service nova] Acquiring lock "3e6cc55c-3284-44ff-85af-642f666910da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56af9de8-2837-463c-839d-8763690326d6 req-ddaae6bc-25c6-454f-b133-7091f3ad1d0d service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56af9de8-2837-463c-839d-8763690326d6 req-ddaae6bc-25c6-454f-b133-7091f3ad1d0d service nova] Lock "3e6cc55c-3284-44ff-85af-642f666910da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-56af9de8-2837-463c-839d-8763690326d6 req-ddaae6bc-25c6-454f-b133-7091f3ad1d0d service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] No waiting events found dispatching network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:18 user nova-compute[73144]: WARNING nova.compute.manager [req-56af9de8-2837-463c-839d-8763690326d6 req-ddaae6bc-25c6-454f-b133-7091f3ad1d0d service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received unexpected event network-vif-plugged-631d9e61-e227-4d9d-a853-640411db0d46 for instance with vm_state deleted and task_state None.
Aug 14 21:52:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-56af9de8-2837-463c-839d-8763690326d6 req-ddaae6bc-25c6-454f-b133-7091f3ad1d0d service nova] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Received event network-vif-deleted-631d9e61-e227-4d9d-a853-640411db0d46 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:19 user nova-compute[73144]: INFO nova.compute.manager [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Terminating instance
Aug 14 21:52:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-3160d582-832f-4cea-8de4-0e69687b50c8 req-fb9fc575-f655-4510-8bdf-7f7539f3d5a0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-vif-unplugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3160d582-832f-4cea-8de4-0e69687b50c8 req-fb9fc575-f655-4510-8bdf-7f7539f3d5a0 service nova] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3160d582-832f-4cea-8de4-0e69687b50c8 req-fb9fc575-f655-4510-8bdf-7f7539f3d5a0 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3160d582-832f-4cea-8de4-0e69687b50c8 req-fb9fc575-f655-4510-8bdf-7f7539f3d5a0 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-3160d582-832f-4cea-8de4-0e69687b50c8 req-fb9fc575-f655-4510-8bdf-7f7539f3d5a0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] No waiting events found dispatching network-vif-unplugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-3160d582-832f-4cea-8de4-0e69687b50c8 req-fb9fc575-f655-4510-8bdf-7f7539f3d5a0 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-vif-unplugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:52:21 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Instance destroyed successfully.
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.objects.instance [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lazy-loading 'resources' on Instance uuid bd2d7d21-f497-4a08-8c70-946dbc83d9db {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-375952859',display_name='tempest-AttachSCSIVolumeTestJSON-server-375952859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-375952859',id=16,image_ref='e196d1f1-d962-47f6-bafb-c464cb219da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPfe7ITLT/pSTBgorOr416fX2nVB33f6TYdXgEKdddgE8L8g4tDBy9PJt/euQpMMW+CLEUMECnQVThA71bFadTlmWl4pJlVyAx75J7v9ubk/L3hO5In1f+y2PEEESKChA==',key_name='tempest-keypair-1394412740',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67bf7988794545408e34d6cb24337601',ramdisk_id='',reservation_id='r-i0x81985',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e196d1f1-d962-47f6-bafb-c464cb219da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-554340252',owner_user_name='tempest-AttachSCSIVolumeTestJSON-554340252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23bddedc457f4297967d717f946eb1e5',uuid=bd2d7d21-f497-4a08-8c70-946dbc83d9db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Converting VIF {"id": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "address": "fa:16:3e:95:d5:8a", "network": {"id": "50fa9030-7d57-4c6c-9735-88f8f1156a39", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-148288739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67bf7988794545408e34d6cb24337601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1673eb-0d", "ovs_interfaceid": "db1673eb-0d2f-4c7d-ab31-2d3b2aac388a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:d5:8a,bridge_name='br-int',has_traffic_filtering=True,id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a,network=Network(50fa9030-7d57-4c6c-9735-88f8f1156a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1673eb-0d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG os_vif [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:d5:8a,bridge_name='br-int',has_traffic_filtering=True,id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a,network=Network(50fa9030-7d57-4c6c-9735-88f8f1156a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1673eb-0d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb1673eb-0d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:21 user nova-compute[73144]: INFO os_vif [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:d5:8a,bridge_name='br-int',has_traffic_filtering=True,id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a,network=Network(50fa9030-7d57-4c6c-9735-88f8f1156a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1673eb-0d')
Aug 14 21:52:21 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Deleting instance files /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db_del
Aug 14 21:52:21 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Deletion of /opt/stack/data/nova/instances/bd2d7d21-f497-4a08-8c70-946dbc83d9db_del complete
Aug 14 21:52:21 user nova-compute[73144]: INFO nova.compute.manager [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 14 21:52:21 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:52:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:22 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Took 1.40 seconds to deallocate network for instance.
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-430ebfc7-9d67-49ac-b5e5-6cb0581a3e47 req-75c93367-f571-4882-9002-8092f6eff015 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-vif-deleted-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:22 user nova-compute[73144]: INFO nova.compute.manager [req-430ebfc7-9d67-49ac-b5e5-6cb0581a3e47 req-75c93367-f571-4882-9002-8092f6eff015 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Neutron deleted interface db1673eb-0d2f-4c7d-ab31-2d3b2aac388a; detaching it from the instance and deleting it from the info cache
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.network.neutron [req-430ebfc7-9d67-49ac-b5e5-6cb0581a3e47 req-75c93367-f571-4882-9002-8092f6eff015 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-430ebfc7-9d67-49ac-b5e5-6cb0581a3e47 req-75c93367-f571-4882-9002-8092f6eff015 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Detach interface failed, port_id=db1673eb-0d2f-4c7d-ab31-2d3b2aac388a, reason: Instance bd2d7d21-f497-4a08-8c70-946dbc83d9db could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-changed-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Refreshing instance network info cache due to event network-changed-f14021d9-c463-48d4-a0db-9dcbca2b75b1. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] Acquiring lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] Acquired lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.network.neutron [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Refreshing network info cache for port f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-3077a839-8524-4d90-8201-d7ee55bf7a82 req-d7114f54-74e9-40f3-b588-c0e90fe6f981 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received event network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3077a839-8524-4d90-8201-d7ee55bf7a82 req-d7114f54-74e9-40f3-b588-c0e90fe6f981 service nova] Acquiring lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3077a839-8524-4d90-8201-d7ee55bf7a82 req-d7114f54-74e9-40f3-b588-c0e90fe6f981 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3077a839-8524-4d90-8201-d7ee55bf7a82 req-d7114f54-74e9-40f3-b588-c0e90fe6f981 service nova] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-3077a839-8524-4d90-8201-d7ee55bf7a82 req-d7114f54-74e9-40f3-b588-c0e90fe6f981 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] No waiting events found dispatching network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:22 user nova-compute[73144]: WARNING nova.compute.manager [req-3077a839-8524-4d90-8201-d7ee55bf7a82 req-d7114f54-74e9-40f3-b588-c0e90fe6f981 service nova] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Received unexpected event network-vif-plugged-db1673eb-0d2f-4c7d-ab31-2d3b2aac388a for instance with vm_state deleted and task_state None.
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:22 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Deleted allocations for instance bd2d7d21-f497-4a08-8c70-946dbc83d9db
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-06b2060d-a384-4c66-b1c1-430fc0836e21 tempest-AttachSCSIVolumeTestJSON-554340252 tempest-AttachSCSIVolumeTestJSON-554340252-project-member] Lock "bd2d7d21-f497-4a08-8c70-946dbc83d9db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.224s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:22 user nova-compute[73144]: INFO nova.compute.manager [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Terminating instance
Aug 14 21:52:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updated VIF entry in instance network info cache for port f14021d9-c463-48d4-a0db-9dcbca2b75b1. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updating instance_info_cache with network_info: [{"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ed22cd50-bb6f-4c2e-afb3-d03a3a365d70 req-2f87e201-4aef-47a6-b856-15a8a9ea6f52 service nova] Releasing lock "refresh_cache-85862011-79d3-488f-885c-e4e907d8ed2f" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:52:23 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Instance destroyed successfully.
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lazy-loading 'resources' on Instance uuid ae3ee52c-0811-4c67-a43e-736e02c5511d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-914541680',display_name='tempest-ServerStableDeviceRescueTest-server-914541680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-914541680',id=3,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvqPD1XevevnipezL0SjTUgZvZ3XCWMcpzIT8W1Hz8KROs2Dej1ChQ3ovfHHgZSHgPR+Q79GjA2RDLnkzpqH66uQu+6OSrmRkc4iMBUpC+s/Bq8BLmXbNVtz9y6R7CGKQ==',key_name='tempest-keypair-1696462956',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:49:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f55f90fe0860498a85da04d2cb3ae6e4',ramdisk_id='',reservation_id='r-rso97t23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-744721021',owner_user_name='tempest-ServerStableDeviceRescueTest-744721021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fea6e7a8eb644f9eb8974663217a3a98',uuid=ae3ee52c-0811-4c67-a43e-736e02c5511d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converting VIF {"id": "3637b061-93ae-454c-88ff-45478c8bdcda", "address": "fa:16:3e:31:42:f6", "network": {"id": "51c68293-5c72-4695-80f0-823297f41335", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-556556410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f55f90fe0860498a85da04d2cb3ae6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3637b061-93", "ovs_interfaceid": "3637b061-93ae-454c-88ff-45478c8bdcda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG os_vif [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3637b061-93, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:23 user nova-compute[73144]: INFO os_vif [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:42:f6,bridge_name='br-int',has_traffic_filtering=True,id=3637b061-93ae-454c-88ff-45478c8bdcda,network=Network(51c68293-5c72-4695-80f0-823297f41335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3637b061-93')
Aug 14 21:52:23 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Deleting instance files /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d_del
Aug 14 21:52:23 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Deletion of /opt/stack/data/nova/instances/ae3ee52c-0811-4c67-a43e-736e02c5511d_del complete
Aug 14 21:52:23 user nova-compute[73144]: INFO nova.compute.manager [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 21:52:23 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:52:23 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-unplugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] Acquiring lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] No waiting events found dispatching network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:24 user nova-compute[73144]: WARNING nova.compute.manager [req-5a863874-a35c-4402-a543-82f7e63a20f3 req-e95fd831-9a60-4a62-80cf-a2552b9b7624 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received unexpected event network-vif-plugged-3637b061-93ae-454c-88ff-45478c8bdcda for instance with vm_state active and task_state deleting.
Aug 14 21:52:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:25 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Took 1.67 seconds to deallocate network for instance.
Aug 14 21:52:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-afa5cb18-2afa-40d9-be29-389beda77c5d req-83eedad7-1bfd-47a2-b16b-55218e912028 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Received event network-vif-deleted-3637b061-93ae-454c-88ff-45478c8bdcda {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:25 user nova-compute[73144]: INFO nova.compute.manager [req-afa5cb18-2afa-40d9-be29-389beda77c5d req-83eedad7-1bfd-47a2-b16b-55218e912028 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Neutron deleted interface 3637b061-93ae-454c-88ff-45478c8bdcda; detaching it from the instance and deleting it from the info cache
Aug 14 21:52:25 user nova-compute[73144]: DEBUG nova.network.neutron [req-afa5cb18-2afa-40d9-be29-389beda77c5d req-83eedad7-1bfd-47a2-b16b-55218e912028 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-afa5cb18-2afa-40d9-be29-389beda77c5d req-83eedad7-1bfd-47a2-b16b-55218e912028 service nova] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Detach interface failed, port_id=3637b061-93ae-454c-88ff-45478c8bdcda, reason: Instance ae3ee52c-0811-4c67-a43e-736e02c5511d could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:52:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:25 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Deleted allocations for instance ae3ee52c-0811-4c67-a43e-736e02c5511d
Aug 14 21:52:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4415f299-8a60-4ee1-a4d6-27149758acd8 tempest-ServerStableDeviceRescueTest-744721021 tempest-ServerStableDeviceRescueTest-744721021-project-member] Lock "ae3ee52c-0811-4c67-a43e-736e02c5511d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lazy-loading 'flavor' on Instance uuid 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:27 user nova-compute[73144]: INFO nova.compute.manager [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Attaching volume 816bed11-5427-417c-a475-f534b39789c8 to /dev/vdb
Aug 14 21:52:27 user nova-compute[73144]: DEBUG os_brick.utils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[200aeeaa-2fb3-41bc-929b-b1aa5842a067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7950f23-5606-4de4-9517-ffa0bed6ad9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a27ce1-f564-42b7-95b7-9be4313998e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f77082-614d-4ee4-87a7-edfe62000d3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:52:27 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:52:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[21da93ec-9eaa-4f58-b132-f4064ace90de]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG os_brick.utils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:52:27 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updating existing volume attachment record: ce9f6c67-89ac-4738-99c4-a770a33de522 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:52:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:31 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049936.801981, 3e6cc55c-3284-44ff-85af-642f666910da => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:52:31 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] VM Stopped (Lifecycle Event)
Aug 14 21:52:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-122af7e3-4685-4e49-8453-79c6354b48f2 None None] [instance: 3e6cc55c-3284-44ff-85af-642f666910da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:52:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:33 user nova-compute[73144]: INFO nova.compute.manager [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Rescuing
Aug 14 21:52:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:52:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:52:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:52:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG nova.network.neutron [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updating instance_info_cache with network_info: [{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance destroyed successfully.
Aug 14 21:52:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Attempting rescue
Aug 14 21:52:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73144) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 21:52:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Creating image(s)
Aug 14 21:52:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG nova.objects.instance [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'trusted_certs' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue" returned: 0 in 0.050s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.objects.instance [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'migration_context' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Start _get_guest_xml network_info=[{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:fc:b4:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '53539290-1600-4e84-8f24-496f41396a43', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.objects.instance [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'resources' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.objects.instance [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'numa_topology' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:35 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:52:35 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.objects.instance [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1484744198',display_name='tempest-ServerRescueNegativeTestJSON-server-1484744198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1484744198',id=21,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-aky6v03n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:52Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=ef7cd461-517e-458c-a22a-d226daf54347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:fc:b4:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:fc:b4:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.objects.instance [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'pci_devices' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:52:35 user nova-compute[73144]:   <uuid>ef7cd461-517e-458c-a22a-d226daf54347</uuid>
Aug 14 21:52:35 user nova-compute[73144]:   <name>instance-00000015</name>
Aug 14 21:52:35 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:52:35 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:52:35 user nova-compute[73144]:   <metadata>
Aug 14 21:52:35 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:52:35 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:52:35 user nova-compute[73144]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1484744198</nova:name>
Aug 14 21:52:35 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:52:35</nova:creationTime>
Aug 14 21:52:35 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:52:35 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:52:35 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:52:35 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:52:35 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:52:35 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:52:35 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:52:35 user nova-compute[73144]:       <nova:owner>
Aug 14 21:52:35 user nova-compute[73144]:         <nova:user uuid="8d90a89f0b384bfbbabfc57e098efc45">tempest-ServerRescueNegativeTestJSON-89538024-project-member</nova:user>
Aug 14 21:52:35 user nova-compute[73144]:         <nova:project uuid="8cc2faa54982470a8ff513ec75cf0546">tempest-ServerRescueNegativeTestJSON-89538024</nova:project>
Aug 14 21:52:35 user nova-compute[73144]:       </nova:owner>
Aug 14 21:52:35 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:52:35 user nova-compute[73144]:       <nova:ports>
Aug 14 21:52:35 user nova-compute[73144]:         <nova:port uuid="4e4e40c9-2a43-419d-b137-1ffaef720831">
Aug 14 21:52:35 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:52:35 user nova-compute[73144]:         </nova:port>
Aug 14 21:52:35 user nova-compute[73144]:       </nova:ports>
Aug 14 21:52:35 user nova-compute[73144]:     </nova:instance>
Aug 14 21:52:35 user nova-compute[73144]:   </metadata>
Aug 14 21:52:35 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:52:35 user nova-compute[73144]:     <system>
Aug 14 21:52:35 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:52:35 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:52:35 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:52:35 user nova-compute[73144]:       <entry name="serial">ef7cd461-517e-458c-a22a-d226daf54347</entry>
Aug 14 21:52:35 user nova-compute[73144]:       <entry name="uuid">ef7cd461-517e-458c-a22a-d226daf54347</entry>
Aug 14 21:52:35 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:52:35 user nova-compute[73144]:     </system>
Aug 14 21:52:35 user nova-compute[73144]:   </sysinfo>
Aug 14 21:52:35 user nova-compute[73144]:   <os>
Aug 14 21:52:35 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:52:35 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:52:35 user nova-compute[73144]:   </os>
Aug 14 21:52:35 user nova-compute[73144]:   <features>
Aug 14 21:52:35 user nova-compute[73144]:     <acpi/>
Aug 14 21:52:35 user nova-compute[73144]:     <apic/>
Aug 14 21:52:35 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:52:35 user nova-compute[73144]:   </features>
Aug 14 21:52:35 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:52:35 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:52:35 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:52:35 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:52:35 user nova-compute[73144]:   </clock>
Aug 14 21:52:35 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:52:35 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:52:35 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:52:35 user nova-compute[73144]:   </cpu>
Aug 14 21:52:35 user nova-compute[73144]:   <devices>
Aug 14 21:52:35 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:52:35 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:52:35 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue"/>
Aug 14 21:52:35 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:52:35 user nova-compute[73144]:     </disk>
Aug 14 21:52:35 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:52:35 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:52:35 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk"/>
Aug 14 21:52:35 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:52:35 user nova-compute[73144]:     </disk>
Aug 14 21:52:35 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:52:35 user nova-compute[73144]:       <mac address="fa:16:3e:fc:b4:58"/>
Aug 14 21:52:35 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:52:35 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:52:35 user nova-compute[73144]:       <target dev="tap4e4e40c9-2a"/>
Aug 14 21:52:35 user nova-compute[73144]:     </interface>
Aug 14 21:52:35 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:52:35 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/console.log" append="off"/>
Aug 14 21:52:35 user nova-compute[73144]:     </serial>
Aug 14 21:52:35 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:52:35 user nova-compute[73144]:     <video>
Aug 14 21:52:35 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:52:35 user nova-compute[73144]:     </video>
Aug 14 21:52:35 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:52:35 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:52:35 user nova-compute[73144]:     </rng>
Aug 14 21:52:35 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:52:35 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:52:35 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:52:35 user nova-compute[73144]:     </memballoon>
Aug 14 21:52:35 user nova-compute[73144]:   </devices>
Aug 14 21:52:35 user nova-compute[73144]: </domain>
Aug 14 21:52:35 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:52:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance destroyed successfully.
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049940.2433608, bd2d7d21-f497-4a08-8c70-946dbc83d9db => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:52:35 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] VM Stopped (Lifecycle Event)
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-3936bbc8-9961-4550-b9ef-5f8a68b4204e None None] [instance: bd2d7d21-f497-4a08-8c70-946dbc83d9db] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:52:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No VIF found with MAC fa:16:3e:fc:b4:58, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUbfglxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:52:36 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:52:36 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:52:36 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5d8edc-b7e6-4d08-9907-d883879404d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:52:36 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[55deb6a4-004b-403b-a22e-e7b7b064ff9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8] added
Aug 14 21:52:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547472f-5f7d-4663-bf8c-6f7e0ae3e5f3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[944d3e68-005d-41aa-8250-554109e6023a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUbfglxM {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUbfglxM" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e9853-5695-4ec2-8153-117718155957]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUbfglxM'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e355f9-e985-42b4-9bae-c9af3454a8f8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[626438b9-b92f-4e47-bd36-ab55059aa4ac]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d42281-228b-4c65-b4ad-3874af53c1ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260]
Aug 14 21:52:36 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260] successful.
Aug 14 21:52:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a56bbc-19f0-44bf-9507-b70699c9c2d7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f3051c-3d98-49ca-964a-a500010dabc5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 (non-flash)
Aug 14 21:52:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3576df-f5b2-4a5c-88cc-cf1def72c922]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:52:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUbfglxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23966383933303132', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966383933303132', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lazy-loading 'flavor' on Instance uuid 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:52:38 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:52:38 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:52:38 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:52:38 user nova-compute[73144]:   <serial>816bed11-5427-417c-a475-f534b39789c8</serial>
Aug 14 21:52:38 user nova-compute[73144]: </disk>
Aug 14 21:52:38 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692049943.5106437, ae3ee52c-0811-4c67-a43e-736e02c5511d => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:52:38 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] VM Stopped (Lifecycle Event)
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] No VIF found with MAC fa:16:3e:86:c7:9b, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b14a36e0-4e68-4863-8cc6-9956d691f816 None None] [instance: ae3ee52c-0811-4c67-a43e-736e02c5511d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d28dda95-54c7-4ffc-b7ec-28919bf2783d tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.355s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for ef7cd461-517e-458c-a22a-d226daf54347 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049958.8624053, ef7cd461-517e-458c-a22a-d226daf54347 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:52:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] VM Resumed (Lifecycle Event)
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-095edbbe-52d1-4a99-a52f-4e5f30abc359 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:52:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049958.863487, ef7cd461-517e-458c-a22a-d226daf54347 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:52:38 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] VM Started (Lifecycle Event)
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:52:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:52:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:40 user nova-compute[73144]: INFO nova.compute.manager [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Detaching volume 816bed11-5427-417c-a475-f534b39789c8
Aug 14 21:52:40 user nova-compute[73144]: INFO nova.virt.block_device [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Attempting to driver detach volume 816bed11-5427-417c-a475-f534b39789c8 from mountpoint /dev/vdb
Aug 14 21:52:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Attempting to detach device vdb from instance 85862011-79d3-488f-885c-e4e907d8ed2f from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:52:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:52:40 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:52:40 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:52:40 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:52:40 user nova-compute[73144]:   <serial>816bed11-5427-417c-a475-f534b39789c8</serial>
Aug 14 21:52:40 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:52:40 user nova-compute[73144]: </disk>
Aug 14 21:52:40 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:52:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Successfully detached device vdb from instance 85862011-79d3-488f-885c-e4e907d8ed2f from the persistent domain config.
Aug 14 21:52:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85862011-79d3-488f-885c-e4e907d8ed2f from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:52:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:52:40 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:52:40 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:52:40 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:52:40 user nova-compute[73144]:   <serial>816bed11-5427-417c-a475-f534b39789c8</serial>
Aug 14 21:52:40 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:52:40 user nova-compute[73144]: </disk>
Aug 14 21:52:40 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692049961.487865, 85862011-79d3-488f-885c-e4e907d8ed2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:52:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Successfully detached device vdb from instance 85862011-79d3-488f-885c-e4e907d8ed2f from the live domain config.
Aug 14 21:52:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUbfglxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:52:41 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3408c554-b37b-418f-b863-936bfb336d12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c34c101-0841-4dda-9214-dd933c825705]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:41 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:41 user nova-compute[73144]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 (non-flash)
Aug 14 21:52:41 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:52:41 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:52:41 user nova-compute[73144]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 (non-flash)
Aug 14 21:52:41 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158676290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d6ffc2-c4e0-4947-905b-f67d28f5431d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3b17d1-336e-42f9-bb27-f9693bbf5182]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-4e94653b-43bc-42db-8538-e598f749d4e1 req-cc05b36d-adbf-4d31-b39a-bbe90f1c9d85 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-unplugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e94653b-43bc-42db-8538-e598f749d4e1 req-cc05b36d-adbf-4d31-b39a-bbe90f1c9d85 service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e94653b-43bc-42db-8538-e598f749d4e1 req-cc05b36d-adbf-4d31-b39a-bbe90f1c9d85 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e94653b-43bc-42db-8538-e598f749d4e1 req-cc05b36d-adbf-4d31-b39a-bbe90f1c9d85 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-4e94653b-43bc-42db-8538-e598f749d4e1 req-cc05b36d-adbf-4d31-b39a-bbe90f1c9d85 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-unplugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:41 user nova-compute[73144]: WARNING nova.compute.manager [req-4e94653b-43bc-42db-8538-e598f749d4e1 req-cc05b36d-adbf-4d31-b39a-bbe90f1c9d85 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received unexpected event network-vif-unplugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with vm_state rescued and task_state None.
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af60e9a-d698-4240-bd70-9822ecd567b0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876171a-104a-4868-a0a0-cba057010936]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda397f8-e8c1-4102-a003-9be7f7bd4b71]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[888390ed-67f8-4f48-8259-6db1cd287226]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260]
Aug 14 21:52:41 user nova-compute[73144]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8, portal: 172.16.0.220,3260] successful.
Aug 14 21:52:41 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816bed11-5427-417c-a475-f534b39789c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[12453374-0cb0-4ee4-842e-3a8dd2ba2a35]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] <== disconnect_volume: return (348ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:52:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:42 user nova-compute[73144]: DEBUG nova.objects.instance [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lazy-loading 'flavor' on Instance uuid 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:52:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-46e2f1e3-66a4-4a2c-87cf-e6f5811bdcdb tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.880s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:43 user nova-compute[73144]: WARNING nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received unexpected event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with vm_state rescued and task_state None.
Aug 14 21:52:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:43 user nova-compute[73144]: WARNING nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received unexpected event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with vm_state rescued and task_state None.
Aug 14 21:52:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:52:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:52:43 user nova-compute[73144]: WARNING nova.compute.manager [req-e92adbf0-dbc7-4792-8d02-315228613ec7 req-51c00967-32d9-4c54-9c6b-b4605ec55622 service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received unexpected event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with vm_state rescued and task_state None.
Aug 14 21:52:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:57 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:52:58 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:52:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:53:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:53:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquired lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG nova.network.neutron [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'info_cache' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:53:06 user nova-compute[73144]: INFO nova.compute.claims [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Claim successful on node user
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG nova.network.neutron [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Releasing lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:07 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:07 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7456MB free_disk=25.3642578125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance destroyed successfully.
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'resources' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG os_vif [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap405993c1-92, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:07 user nova-compute[73144]: INFO os_vif [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92')
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Start _get_guest_xml network_info=[{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:07 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:07 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:53:07 user nova-compute[73144]:   <uuid>5fb72bd6-7deb-4a48-b1ef-410911faec15</uuid>
Aug 14 21:53:07 user nova-compute[73144]:   <name>instance-00000004</name>
Aug 14 21:53:07 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:53:07 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:53:07 user nova-compute[73144]:   <metadata>
Aug 14 21:53:07 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:53:07 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:53:07 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeTestJSON-server-1723144730</nova:name>
Aug 14 21:53:07 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:53:07</nova:creationTime>
Aug 14 21:53:07 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:53:07 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:53:07 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:53:07 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:53:07 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:53:07 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:53:07 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:53:07 user nova-compute[73144]:       <nova:owner>
Aug 14 21:53:07 user nova-compute[73144]:         <nova:user uuid="89f3461a4f8f45e584180e2b18d782b0">tempest-AttachVolumeTestJSON-881893264-project-member</nova:user>
Aug 14 21:53:07 user nova-compute[73144]:         <nova:project uuid="3842f55070374c288d0e1500d297485e">tempest-AttachVolumeTestJSON-881893264</nova:project>
Aug 14 21:53:07 user nova-compute[73144]:       </nova:owner>
Aug 14 21:53:07 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:53:07 user nova-compute[73144]:       <nova:ports>
Aug 14 21:53:07 user nova-compute[73144]:         <nova:port uuid="405993c1-92ac-4e9f-b75c-44deb4a9f3dd">
Aug 14 21:53:07 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 21:53:07 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:07 user nova-compute[73144]:       </nova:ports>
Aug 14 21:53:07 user nova-compute[73144]:     </nova:instance>
Aug 14 21:53:07 user nova-compute[73144]:   </metadata>
Aug 14 21:53:07 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:53:07 user nova-compute[73144]:     <system>
Aug 14 21:53:07 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:53:07 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:53:07 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:53:07 user nova-compute[73144]:       <entry name="serial">5fb72bd6-7deb-4a48-b1ef-410911faec15</entry>
Aug 14 21:53:07 user nova-compute[73144]:       <entry name="uuid">5fb72bd6-7deb-4a48-b1ef-410911faec15</entry>
Aug 14 21:53:07 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:53:07 user nova-compute[73144]:     </system>
Aug 14 21:53:07 user nova-compute[73144]:   </sysinfo>
Aug 14 21:53:07 user nova-compute[73144]:   <os>
Aug 14 21:53:07 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:53:07 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:53:07 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:53:07 user nova-compute[73144]:   </os>
Aug 14 21:53:07 user nova-compute[73144]:   <features>
Aug 14 21:53:07 user nova-compute[73144]:     <acpi/>
Aug 14 21:53:07 user nova-compute[73144]:     <apic/>
Aug 14 21:53:07 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:53:07 user nova-compute[73144]:   </features>
Aug 14 21:53:07 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:53:07 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:53:07 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:53:07 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:53:07 user nova-compute[73144]:   </clock>
Aug 14 21:53:07 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:53:07 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:53:07 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:53:07 user nova-compute[73144]:   </cpu>
Aug 14 21:53:07 user nova-compute[73144]:   <devices>
Aug 14 21:53:07 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:53:07 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:53:07 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk"/>
Aug 14 21:53:07 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:53:07 user nova-compute[73144]:     </disk>
Aug 14 21:53:07 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:07 user nova-compute[73144]:       <mac address="fa:16:3e:fb:d3:d3"/>
Aug 14 21:53:07 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:07 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:07 user nova-compute[73144]:       <target dev="tap405993c1-92"/>
Aug 14 21:53:07 user nova-compute[73144]:     </interface>
Aug 14 21:53:07 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:53:07 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/console.log" append="off"/>
Aug 14 21:53:07 user nova-compute[73144]:     </serial>
Aug 14 21:53:07 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:53:07 user nova-compute[73144]:     <video>
Aug 14 21:53:07 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:07 user nova-compute[73144]:     </video>
Aug 14 21:53:07 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:53:07 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:53:07 user nova-compute[73144]:     </rng>
Aug 14 21:53:07 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:53:07 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:53:07 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:53:07 user nova-compute[73144]:     </memballoon>
Aug 14 21:53:07 user nova-compute[73144]:   </devices>
Aug 14 21:53:07 user nova-compute[73144]: </domain>
Aug 14 21:53:07 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.139s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.474s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:53:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ea802951-a15c-4dac-a693-4fe96ef3cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance abb6bbee-268b-45c6-b3da-49ecc86944c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 85862011-79d3-488f-885c-e4e907d8ed2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 97776072-7d34-4549-8f2e-bc01db5cba92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 67dcd12b-616a-4f37-ad82-af85e2226b9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:53:08 user nova-compute[73144]: INFO nova.virt.block_device [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Booting with volume 20b98d8f-a7bc-4e67-ae92-c0581e61f342 at /dev/vda
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG os_brick.utils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e63a0a6-0bc1-400e-9de1-e7d7b3c7a380]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db714b-380e-401c-ae07-a09348ccb117]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.policy [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18fdf2b8e2ee449abe89a18894616034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe822873f364fd19080cb7b9eb80b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d88628-2de0-47b7-9cc0-d0a6817fc21a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b5648e-94c5-4781-91cc-8e70f71c4101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:08 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Cannot resize image /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'migration_context' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0f0d43-6743-4943-ab42-7bc2b99b5613]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG os_brick.utils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating existing volume attachment record: 0077357e-1563-475e-b5c3-9fe5886276a3 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG os_vif [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap405993c1-92, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap405993c1-92, col_values=(('external_ids', {'iface-id': '405993c1-92ac-4e9f-b75c-44deb4a9f3dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:d3:d3', 'vm-uuid': '5fb72bd6-7deb-4a48-b1ef-410911faec15'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:08 user nova-compute[73144]: INFO os_vif [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92')
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:08 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully created port: ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Skipping network cache update for instance because it is Building. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully created port: fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-dbd2ca77-165a-421b-8020-ef5825780905 req-4083f48f-99e2-423b-be5f-2651a5c888f2 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dbd2ca77-165a-421b-8020-ef5825780905 req-4083f48f-99e2-423b-be5f-2651a5c888f2 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dbd2ca77-165a-421b-8020-ef5825780905 req-4083f48f-99e2-423b-be5f-2651a5c888f2 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dbd2ca77-165a-421b-8020-ef5825780905 req-4083f48f-99e2-423b-be5f-2651a5c888f2 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-dbd2ca77-165a-421b-8020-ef5825780905 req-4083f48f-99e2-423b-be5f-2651a5c888f2 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:10 user nova-compute[73144]: WARNING nova.compute.manager [req-dbd2ca77-165a-421b-8020-ef5825780905 req-4083f48f-99e2-423b-be5f-2651a5c888f2 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state stopped and task_state powering-on.
Aug 14 21:53:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [{"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-5fb72bd6-7deb-4a48-b1ef-410911faec15" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully created port: 4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:53:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:11 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully created port: 48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:53:11 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049991.984242, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:53:11 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Resumed (Lifecycle Event)
Aug 14 21:53:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:53:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance rebooted successfully.
Aug 14 21:53:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-92823314-86e2-4648-b4f3-d8a4f78dd65e tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:53:12 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692049991.987797, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:53:12 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Started (Lifecycle Event)
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully created port: 935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-4dfd06b7-ae0b-4861-a987-d6ac6df9eea0 req-38f346f0-6a32-43ef-a20d-e990ddabbfe3 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4dfd06b7-ae0b-4861-a987-d6ac6df9eea0 req-38f346f0-6a32-43ef-a20d-e990ddabbfe3 service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4dfd06b7-ae0b-4861-a987-d6ac6df9eea0 req-38f346f0-6a32-43ef-a20d-e990ddabbfe3 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4dfd06b7-ae0b-4861-a987-d6ac6df9eea0 req-38f346f0-6a32-43ef-a20d-e990ddabbfe3 service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-4dfd06b7-ae0b-4861-a987-d6ac6df9eea0 req-38f346f0-6a32-43ef-a20d-e990ddabbfe3 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:12 user nova-compute[73144]: WARNING nova.compute.manager [req-4dfd06b7-ae0b-4861-a987-d6ac6df9eea0 req-38f346f0-6a32-43ef-a20d-e990ddabbfe3 service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state active and task_state None.
Aug 14 21:53:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully updated port: ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-ea4de1a3-ece8-4141-b210-addf8b81a5ee. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c4f770a5-fc14-41d2-8cde-3be3c53c30e8 req-e3d2e442-043d-4514-b9d4-da653b0a2ede service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully updated port: b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully updated port: ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-b4e21ba3-1dd5-4c3d-9572-28e009ce042c. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully updated port: fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc240417-a1d6-4f92-ba3b-b36fda2035aa req-e2b4803e-08b5-4f02-92c5-912342130b81 service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:16 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully updated port: 4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-fca1c03f-8518-4eed-a927-63c7e1c45b2d. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully updated port: 48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-4796b9c3-23ac-4eec-8509-ffb653d10123. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port 4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:53:17 user nova-compute[73144]: INFO nova.virt.block_device [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Booting with volume 82e5fd13-7e9a-43fc-ad05-2296d22e7208 at /dev/vdb
Aug 14 21:53:17 user nova-compute[73144]: DEBUG os_brick.utils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ced613-f1f7-4fa6-ad17-a49016cbe341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG nova.network.neutron [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e346b61-89e3-4448-8a6c-f48fb8ef8342]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cb5d0a81-91cf-484a-b9b1-2b9f72866e18 req-330be424-7bc9-41b6-ab3a-6311e4ceeb8f service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88bcb7-315d-4567-b49c-d2de3ab7ee6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6dccf6-c3ac-445b-bf9e-11adaa4abe41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:18 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc228b8a-588f-4cca-9e7b-3a0d95e68813]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG os_brick.utils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating existing volume attachment record: 25f5a433-0907-40eb-8597-b016687cc38c {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Successfully updated port: 935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-935a7ffd-3099-4412-98d4-be9ee95301dd. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:53:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [{"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance network_info: |[{"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port 935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updated VIF entry in instance network info cache for port 935a7ffd-3099-4412-98d4-be9ee95301dd. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [{"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5aa0cbce-f824-4853-8efc-d589c60689cd req-8611003a-7809-498a-b885-bc035cb7a94a service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port 48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:22 user nova-compute[73144]: DEBUG nova.network.neutron [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updated VIF entry in instance network info cache for port 48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:53:22 user nova-compute[73144]: DEBUG nova.network.neutron [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [{"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0591e552-2454-43e6-9ddc-2e5d1ecaba50 req-99ee7ad8-daca-4f34-b9f2-ed67ba9e8683 service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:28 user nova-compute[73144]: INFO nova.virt.block_device [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Booting with volume 8e6138b4-c75e-4c36-8cc4-c2500f228dab at /dev/vdc
Aug 14 21:53:28 user nova-compute[73144]: DEBUG os_brick.utils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ba256e-c1f4-40c2-b665-f92c91dbddf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faf844a-2096-46c5-a95f-2571469ae9bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[978abff3-0046-4df4-9161-a57d815e42ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9850463-9f88-44b3-b4b5-8c60003bd4c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:28 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:53:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[001b3c45-b812-4f56-a22c-9ca1f9e066aa]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG os_brick.utils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating existing volume attachment record: 26827c99-593a-4059-a3d1-30cde05bc0d1 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:53:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:39 user nova-compute[73144]: INFO nova.compute.manager [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Terminating instance
Aug 14 21:53:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-f9039e15-b6c4-4975-902c-62261606b1df req-75d222d6-c85c-4117-a7c0-dea95338be07 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-vif-unplugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9039e15-b6c4-4975-902c-62261606b1df req-75d222d6-c85c-4117-a7c0-dea95338be07 service nova] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9039e15-b6c4-4975-902c-62261606b1df req-75d222d6-c85c-4117-a7c0-dea95338be07 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f9039e15-b6c4-4975-902c-62261606b1df req-75d222d6-c85c-4117-a7c0-dea95338be07 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-f9039e15-b6c4-4975-902c-62261606b1df req-75d222d6-c85c-4117-a7c0-dea95338be07 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] No waiting events found dispatching network-vif-unplugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-f9039e15-b6c4-4975-902c-62261606b1df req-75d222d6-c85c-4117-a7c0-dea95338be07 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-vif-unplugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Instance destroyed successfully.
Aug 14 21:53:40 user nova-compute[73144]: DEBUG nova.objects.instance [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lazy-loading 'resources' on Instance uuid 85862011-79d3-488f-885c-e4e907d8ed2f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2059551550',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2059551550',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2059551',id=19,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6k5ZR5oBgF37opGFaOC4gdtIrHo6vypO0duVIO2PraWsyBZKauNt6LkOG/lFgokBp9bqfmblSj/iPo3E4dOILQT8ER2WaTPJbCL7/6NN65gtAMt+CxSpmQXK+rE1wcNg==',key_name='tempest-keypair-1105846074',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='851048f52e82435c83e399fb66c4e889',ramdisk_id='',reservation_id='r-zx20sonv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2064149381',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645f84b0b6c4466899b87b5f38b5698f',uuid=85862011-79d3-488f-885c-e4e907d8ed2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Converting VIF {"id": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "address": "fa:16:3e:86:c7:9b", "network": {"id": "292b23fd-ea19-4745-9a7f-9a23b6183a41", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-776925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "851048f52e82435c83e399fb66c4e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14021d9-c4", "ovs_interfaceid": "f14021d9-c463-48d4-a0db-9dcbca2b75b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:c7:9b,bridge_name='br-int',has_traffic_filtering=True,id=f14021d9-c463-48d4-a0db-9dcbca2b75b1,network=Network(292b23fd-ea19-4745-9a7f-9a23b6183a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14021d9-c4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG os_vif [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:c7:9b,bridge_name='br-int',has_traffic_filtering=True,id=f14021d9-c463-48d4-a0db-9dcbca2b75b1,network=Network(292b23fd-ea19-4745-9a7f-9a23b6183a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14021d9-c4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf14021d9-c4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:40 user nova-compute[73144]: INFO os_vif [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:c7:9b,bridge_name='br-int',has_traffic_filtering=True,id=f14021d9-c463-48d4-a0db-9dcbca2b75b1,network=Network(292b23fd-ea19-4745-9a7f-9a23b6183a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14021d9-c4')
Aug 14 21:53:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Deleting instance files /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f_del
Aug 14 21:53:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Deletion of /opt/stack/data/nova/instances/85862011-79d3-488f-885c-e4e907d8ed2f_del complete
Aug 14 21:53:40 user nova-compute[73144]: INFO nova.compute.manager [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 14 21:53:40 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:53:40 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:53:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-e17ae39d-99c9-44c6-91f4-764228707d72 req-279e3ba0-f242-47e3-b61c-0c46a7564fb0 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e17ae39d-99c9-44c6-91f4-764228707d72 req-279e3ba0-f242-47e3-b61c-0c46a7564fb0 service nova] Acquiring lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e17ae39d-99c9-44c6-91f4-764228707d72 req-279e3ba0-f242-47e3-b61c-0c46a7564fb0 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e17ae39d-99c9-44c6-91f4-764228707d72 req-279e3ba0-f242-47e3-b61c-0c46a7564fb0 service nova] Lock "85862011-79d3-488f-885c-e4e907d8ed2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-e17ae39d-99c9-44c6-91f4-764228707d72 req-279e3ba0-f242-47e3-b61c-0c46a7564fb0 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] No waiting events found dispatching network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:41 user nova-compute[73144]: WARNING nova.compute.manager [req-e17ae39d-99c9-44c6-91f4-764228707d72 req-279e3ba0-f242-47e3-b61c-0c46a7564fb0 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received unexpected event network-vif-plugged-f14021d9-c463-48d4-a0db-9dcbca2b75b1 for instance with vm_state active and task_state deleting.
Aug 14 21:53:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:42 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:42 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Took 2.76 seconds to deallocate network for instance.
Aug 14 21:53:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-e4034fbf-7edc-4340-a21d-9f5e758d7834 req-5dbb5e65-4025-4c8e-b4bd-3c6d5f443320 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Received event network-vif-deleted-f14021d9-c463-48d4-a0db-9dcbca2b75b1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:42 user nova-compute[73144]: INFO nova.compute.manager [req-e4034fbf-7edc-4340-a21d-9f5e758d7834 req-5dbb5e65-4025-4c8e-b4bd-3c6d5f443320 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Neutron deleted interface f14021d9-c463-48d4-a0db-9dcbca2b75b1; detaching it from the instance and deleting it from the info cache
Aug 14 21:53:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-e4034fbf-7edc-4340-a21d-9f5e758d7834 req-5dbb5e65-4025-4c8e-b4bd-3c6d5f443320 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-e4034fbf-7edc-4340-a21d-9f5e758d7834 req-5dbb5e65-4025-4c8e-b4bd-3c6d5f443320 service nova] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Detach interface failed, port_id=f14021d9-c463-48d4-a0db-9dcbca2b75b1, reason: Instance 85862011-79d3-488f-885c-e4e907d8ed2f could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-changed-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Refreshing instance network info cache due to event network-changed-a01c90a6-af4f-47c5-98ac-b2bb00fa2006. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] Acquiring lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] Acquired lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:43 user nova-compute[73144]: DEBUG nova.network.neutron [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Refreshing network info cache for port a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:43 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Deleted allocations for instance 85862011-79d3-488f-885c-e4e907d8ed2f
Aug 14 21:53:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f42de55-36e5-4532-bdfc-7aa48365ce58 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381 tempest-TestServerVolumeAttachScenarioOldVersion-2064149381-project-member] Lock "85862011-79d3-488f-885c-e4e907d8ed2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.706s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updated VIF entry in instance network info cache for port a01c90a6-af4f-47c5-98ac-b2bb00fa2006. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:53:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updating instance_info_cache with network_info: [{"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-379e2e30-2bd4-4016-94e0-7458dbc2b3c5 req-b0b13cc0-8fe9-453e-9b2c-b27acd9c5c2e service nova] Releasing lock "refresh_cache-97776072-7d34-4549-8f2e-bc01db5cba92" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:53:45 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Creating image(s)
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Ensure instance console log exists: /opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Start _get_guest_xml network_info=[{"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '0077357e-1563-475e-b5c3-9fe5886276a3', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RygvTuMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67dcd12b-616a-4f37-ad82-af85e2226b9c', 'attached_at': '', 'detached_at': '', 'volume_id': '20b98d8f-a7bc-4e67-ae92-c0581e61f342', 'serial': '20b98d8f-a7bc-4e67-ae92-c0581e61f342'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'disk_bus': 'virtio', 'attachment_id': '25f5a433-0907-40eb-8597-b016687cc38c', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwGVqlMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67dcd12b-616a-4f37-ad82-af85e2226b9c', 'attached_at': '', 'detached_at': '', 'volume_id': '82e5fd13-7e9a-43fc-ad05-2296d22e7208', 'serial': '82e5fd13-7e9a-43fc-ad05-2296d22e7208'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'disk_bus': 'virtio', 'attachment_id': '26827c99-593a-4059-a3d1-30cde05bc0d1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqsHyfEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67dcd12b-616a-4f37-ad82-af85e2226b9c', 'attached_at': '', 'detached_at': '', 'volume_id': '8e6138b4-c75e-4c36-8cc4-c2500f228dab', 'serial': '8e6138b4-c75e-4c36-8cc4-c2500f228dab'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:53:45 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:45 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RygvTuMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:45 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:45 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:45 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27ea22c-1aef-408c-93e1-edfd8a5c97d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:53:45 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bfbcf6-de96-4a41-baf1-b7f2bc334f9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342] added
Aug 14 21:53:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a62bc-1be6-4782-a19d-c72bfb7bb6d1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e5ba70-0053-4af6-a225-989a72700b9f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RygvTuMs {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RygvTuMs" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f96b2-619c-436e-99e0-33f37a1c3bfd]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RygvTuMs'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3535d104-af04-4d2e-92a3-e3246ae2ad32]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd345b05-b22b-4d8a-a336-e39110a5f577]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221ee087-874b-48be-bcb0-efbbf9a15083 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221ee087-874b-48be-bcb0-efbbf9a15083 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221ee087-874b-48be-bcb0-efbbf9a15083 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe5a48b-78c0-4caf-941e-30e51ed1311b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260]
Aug 14 21:53:45 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260] successful.
Aug 14 21:53:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc36d82-2198-41f2-b527-42784e76aedf]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59132f4-f2c9-4cc0-92dc-51e47443b137]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.067s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[860d2147-6398-42a5-821a-6caf0df5f82b]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:53:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RygvTuMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:53:46 user nova-compute[73144]: INFO nova.compute.claims [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Claim successful on node user
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:53:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.policy [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11172444b2d54c0dae51f822168f586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69745a6a4d3345fcb143da4f825a2100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:53:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Creating image(s)
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23037643939353733', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037643939353733', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwGVqlMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:47 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:47 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:47 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec981ac-49cd-45ec-80dd-33ba59ede0ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:53:47 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af3eff9-6033-4108-a4cc-66a5c4f9c83e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208] added
Aug 14 21:53:47 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[070564df-595a-466b-b181-1d7e64ffeedd]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[685b13b6-517c-43ed-8e81-326fc89eabee]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.229s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwGVqlMr {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwGVqlMr" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee62bac7-d19f-402b-8dba-f32f320e9865]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dwGVqlMr'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538a94e-3ca5-4084-892f-907f2a6ce3f3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[171d9933-cc44-49d1-acc7-9c1c13cee597]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[955db1e8-12b4-4b86-8ea5-87242ede6ef1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260]
Aug 14 21:53:47 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260] successful.
Aug 14 21:53:47 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f93d55d-b60c-40e6-bd97-f9bc80d591f4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde7efc7-b958-4405-b142-301a4f6af88d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:47 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk 1073741824" returned: 0 in 0.057s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f1ec7f-3b1b-4d88-9433-5224fa2615b6]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwGVqlMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG nova.network.neutron [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Successfully created port: f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Cannot resize image /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'migration_context' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Ensure instance console log exists: /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '26430623662316362', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430623662316362', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG nova.objects.instance [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid 97776072-7d34-4549-8f2e-bc01db5cba92 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqsHyfEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:48 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:48 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:48 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[57999911-01b7-42b7-a837-a4a45af68c7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:53:48 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f307094-57eb-47d7-973a-a1e81fc265b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab] added
Aug 14 21:53:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276de8d-0934-43c9-9832-f800716d0325]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef0b22-d4fb-4d52-abc6-f0b9bf4c332a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqsHyfEU {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqsHyfEU" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c536d-9f27-4c4a-8165-14f26e5406b6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JqsHyfEU'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[15416c9d-d758-47e8-bc77-b251923310a6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97c889-014f-4e61-9c82-0099760efe40]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:48 user nova-compute[73144]: INFO nova.compute.manager [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Attaching volume 07ad9b33-bb1d-4bbe-bc76-9e0ecada908a to /dev/vdb
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508ae3f-a5f3-40aa-bdef-9249c609aae5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260]
Aug 14 21:53:48 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260] successful.
Aug 14 21:53:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.utils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c38582-4862-4a63-b6ad-c01a59b6c4f0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d902846d-f072-4f28-afc1-ab901c4a3659]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab303cf-08fd-4fd0-be79-ec74f30ee5ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3ac54e-2dc6-435b-994c-19215bc86378]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:53:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:48 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:53:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4241d-4b96-4f36-a844-e7366a420dfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0779fc58-dcfe-41d2-88c3-ea1ba251aa16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8415e9-9f82-425f-81bc-f00d8df6a53c]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqsHyfEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:53:48 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:53:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a57d3-3deb-4e54-95c1-574566925c37]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG os_brick.utils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updating existing volume attachment record: b3e4f446-2972-4dfd-ab78-f4301fb8934d {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:53:48 user nova-compute[73144]: DEBUG nova.network.neutron [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Successfully updated port: f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquired lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing instance network info cache due to event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] Acquiring lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Releasing lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance network_info: |[{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] Acquired lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Start _get_guest_xml network_info=[{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:53:49 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:49 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1737547142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1737547142',id=24,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH38bkufm/qGiYeooM925P2qMy5I531AMDQ4MiSpll0SMC2jTiN6Xml+/7KbitUtc/eB/HVnvu5PMqygkBkSM2zwNVpjUWVIPJ0s517qp32qOXrsZbOYDoSHGkjfB3PqQ==',key_name='tempest-keypair-1826093270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-gir6zm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=db61b783-50d7-4304-a031-f9fb11069ef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.objects.instance [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'pci_devices' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:53:49 user nova-compute[73144]:   <uuid>db61b783-50d7-4304-a031-f9fb11069ef1</uuid>
Aug 14 21:53:49 user nova-compute[73144]:   <name>instance-00000018</name>
Aug 14 21:53:49 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:53:49 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:53:49 user nova-compute[73144]:   <metadata>
Aug 14 21:53:49 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:53:49 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:53:49 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1737547142</nova:name>
Aug 14 21:53:49 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:53:49</nova:creationTime>
Aug 14 21:53:49 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:53:49 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:53:49 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:53:49 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:53:49 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:53:49 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:53:49 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:53:49 user nova-compute[73144]:       <nova:owner>
Aug 14 21:53:49 user nova-compute[73144]:         <nova:user uuid="11172444b2d54c0dae51f822168f586a">tempest-AttachVolumeShelveTestJSON-1156240232-project-member</nova:user>
Aug 14 21:53:49 user nova-compute[73144]:         <nova:project uuid="69745a6a4d3345fcb143da4f825a2100">tempest-AttachVolumeShelveTestJSON-1156240232</nova:project>
Aug 14 21:53:49 user nova-compute[73144]:       </nova:owner>
Aug 14 21:53:49 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:53:49 user nova-compute[73144]:       <nova:ports>
Aug 14 21:53:49 user nova-compute[73144]:         <nova:port uuid="f39a4a57-be14-4d33-b6d0-f6e8469b9d55">
Aug 14 21:53:49 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 21:53:49 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:49 user nova-compute[73144]:       </nova:ports>
Aug 14 21:53:49 user nova-compute[73144]:     </nova:instance>
Aug 14 21:53:49 user nova-compute[73144]:   </metadata>
Aug 14 21:53:49 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:53:49 user nova-compute[73144]:     <system>
Aug 14 21:53:49 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:53:49 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:53:49 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:53:49 user nova-compute[73144]:       <entry name="serial">db61b783-50d7-4304-a031-f9fb11069ef1</entry>
Aug 14 21:53:49 user nova-compute[73144]:       <entry name="uuid">db61b783-50d7-4304-a031-f9fb11069ef1</entry>
Aug 14 21:53:49 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:53:49 user nova-compute[73144]:     </system>
Aug 14 21:53:49 user nova-compute[73144]:   </sysinfo>
Aug 14 21:53:49 user nova-compute[73144]:   <os>
Aug 14 21:53:49 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:53:49 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:53:49 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:53:49 user nova-compute[73144]:   </os>
Aug 14 21:53:49 user nova-compute[73144]:   <features>
Aug 14 21:53:49 user nova-compute[73144]:     <acpi/>
Aug 14 21:53:49 user nova-compute[73144]:     <apic/>
Aug 14 21:53:49 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:53:49 user nova-compute[73144]:   </features>
Aug 14 21:53:49 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:53:49 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:53:49 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:53:49 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:53:49 user nova-compute[73144]:   </clock>
Aug 14 21:53:49 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:53:49 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:53:49 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:53:49 user nova-compute[73144]:   </cpu>
Aug 14 21:53:49 user nova-compute[73144]:   <devices>
Aug 14 21:53:49 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:53:49 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:53:49 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk"/>
Aug 14 21:53:49 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:53:49 user nova-compute[73144]:     </disk>
Aug 14 21:53:49 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:49 user nova-compute[73144]:       <mac address="fa:16:3e:93:8d:d6"/>
Aug 14 21:53:49 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:49 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:49 user nova-compute[73144]:       <target dev="tapf39a4a57-be"/>
Aug 14 21:53:49 user nova-compute[73144]:     </interface>
Aug 14 21:53:49 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:53:49 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/console.log" append="off"/>
Aug 14 21:53:49 user nova-compute[73144]:     </serial>
Aug 14 21:53:49 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:53:49 user nova-compute[73144]:     <video>
Aug 14 21:53:49 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:49 user nova-compute[73144]:     </video>
Aug 14 21:53:49 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:53:49 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:53:49 user nova-compute[73144]:     </rng>
Aug 14 21:53:49 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:53:49 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:53:49 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:53:49 user nova-compute[73144]:     </memballoon>
Aug 14 21:53:49 user nova-compute[73144]:   </devices>
Aug 14 21:53:49 user nova-compute[73144]: </domain>
Aug 14 21:53:49 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1737547142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1737547142',id=24,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH38bkufm/qGiYeooM925P2qMy5I531AMDQ4MiSpll0SMC2jTiN6Xml+/7KbitUtc/eB/HVnvu5PMqygkBkSM2zwNVpjUWVIPJ0s517qp32qOXrsZbOYDoSHGkjfB3PqQ==',key_name='tempest-keypair-1826093270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-gir6zm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=db61b783-50d7-4304-a031-f9fb11069ef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG os_vif [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf39a4a57-be, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf39a4a57-be, col_values=(('external_ids', {'iface-id': 'f39a4a57-be14-4d33-b6d0-f6e8469b9d55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:8d:d6', 'vm-uuid': 'db61b783-50d7-4304-a031-f9fb11069ef1'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:49 user nova-compute[73144]: INFO os_vif [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be')
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No VIF found with MAC fa:16:3e:93:8d:d6, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updated VIF entry in instance network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26664353931356166', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664353931356166', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9f61404e-8301-4940-ab6c-061131e91621 req-669ec1b6-2936-4e6c-a8ed-d3d28be73617 service nova] Releasing lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=ea4de1a3-ece8-4141-b210-addf8b81a5ee,network=Network(5cdf94fe-3767-4925-b563-19c604cfb7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4de1a3-ec') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:44,bridge_name='br-int',has_traffic_filtering=True,id=b4e21ba3-1dd5-4c3d-9572-28e009ce042c,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4e21ba3-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:49 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea49fecc-0b') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:66:9b,bridge_name='br-int',has_traffic_filtering=True,id=fca1c03f-8518-4eed-a927-63c7e1c45b2d,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca1c03f-85') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8e:27,bridge_name='br-int',has_traffic_filtering=True,id=4796b9c3-23ac-4eec-8509-ffb653d10123,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4796b9c3-23') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:9e,bridge_name='br-int',has_traffic_filtering=True,id=48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f70a89-3a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:dd:c2,bridge_name='br-int',has_traffic_filtering=True,id=935a7ffd-3099-4412-98d4-be9ee95301dd,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935a7ffd-30') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lazy-loading 'pci_devices' on Instance uuid 67dcd12b-616a-4f37-ad82-af85e2226b9c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:53:50 user nova-compute[73144]:   <uuid>67dcd12b-616a-4f37-ad82-af85e2226b9c</uuid>
Aug 14 21:53:50 user nova-compute[73144]:   <name>instance-00000017</name>
Aug 14 21:53:50 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:53:50 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:53:50 user nova-compute[73144]:   <metadata>
Aug 14 21:53:50 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:53:50 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:53:50 user nova-compute[73144]:       <nova:name>tempest-device-tagging-server-1820694624</nova:name>
Aug 14 21:53:50 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:53:45</nova:creationTime>
Aug 14 21:53:50 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:53:50 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:53:50 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:53:50 user nova-compute[73144]:       <nova:owner>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:user uuid="18fdf2b8e2ee449abe89a18894616034">tempest-TaggedBootDevicesTest_v242-809499599-project-member</nova:user>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:project uuid="5fe822873f364fd19080cb7b9eb80b05">tempest-TaggedBootDevicesTest_v242-809499599</nova:project>
Aug 14 21:53:50 user nova-compute[73144]:       </nova:owner>
Aug 14 21:53:50 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:53:50 user nova-compute[73144]:       <nova:ports>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:port uuid="ea4de1a3-ece8-4141-b210-addf8b81a5ee">
Aug 14 21:53:50 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 21:53:50 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:port uuid="b4e21ba3-1dd5-4c3d-9572-28e009ce042c">
Aug 14 21:53:50 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Aug 14 21:53:50 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:port uuid="ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5">
Aug 14 21:53:50 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Aug 14 21:53:50 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:port uuid="fca1c03f-8518-4eed-a927-63c7e1c45b2d">
Aug 14 21:53:50 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Aug 14 21:53:50 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:port uuid="4796b9c3-23ac-4eec-8509-ffb653d10123">
Aug 14 21:53:50 user nova-compute[73144]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Aug 14 21:53:50 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:port uuid="48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1">
Aug 14 21:53:50 user nova-compute[73144]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 21:53:50 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:50 user nova-compute[73144]:         <nova:port uuid="935a7ffd-3099-4412-98d4-be9ee95301dd">
Aug 14 21:53:50 user nova-compute[73144]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 21:53:50 user nova-compute[73144]:         </nova:port>
Aug 14 21:53:50 user nova-compute[73144]:       </nova:ports>
Aug 14 21:53:50 user nova-compute[73144]:     </nova:instance>
Aug 14 21:53:50 user nova-compute[73144]:   </metadata>
Aug 14 21:53:50 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:53:50 user nova-compute[73144]:     <system>
Aug 14 21:53:50 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:53:50 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:53:50 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:53:50 user nova-compute[73144]:       <entry name="serial">67dcd12b-616a-4f37-ad82-af85e2226b9c</entry>
Aug 14 21:53:50 user nova-compute[73144]:       <entry name="uuid">67dcd12b-616a-4f37-ad82-af85e2226b9c</entry>
Aug 14 21:53:50 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:53:50 user nova-compute[73144]:     </system>
Aug 14 21:53:50 user nova-compute[73144]:   </sysinfo>
Aug 14 21:53:50 user nova-compute[73144]:   <os>
Aug 14 21:53:50 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:53:50 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:53:50 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:53:50 user nova-compute[73144]:   </os>
Aug 14 21:53:50 user nova-compute[73144]:   <features>
Aug 14 21:53:50 user nova-compute[73144]:     <acpi/>
Aug 14 21:53:50 user nova-compute[73144]:     <apic/>
Aug 14 21:53:50 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:53:50 user nova-compute[73144]:   </features>
Aug 14 21:53:50 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:53:50 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:53:50 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:53:50 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:53:50 user nova-compute[73144]:   </clock>
Aug 14 21:53:50 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:53:50 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:53:50 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:53:50 user nova-compute[73144]:   </cpu>
Aug 14 21:53:50 user nova-compute[73144]:   <devices>
Aug 14 21:53:50 user nova-compute[73144]:     <disk type="file" device="cdrom">
Aug 14 21:53:50 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 21:53:50 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c/disk.config"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="hda" bus="ide"/>
Aug 14 21:53:50 user nova-compute[73144]:     </disk>
Aug 14 21:53:50 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:53:50 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:53:50 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <serial>20b98d8f-a7bc-4e67-ae92-c0581e61f342</serial>
Aug 14 21:53:50 user nova-compute[73144]:     </disk>
Aug 14 21:53:50 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:53:50 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:53:50 user nova-compute[73144]:       <source dev="/dev/sde"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <serial>82e5fd13-7e9a-43fc-ad05-2296d22e7208</serial>
Aug 14 21:53:50 user nova-compute[73144]:     </disk>
Aug 14 21:53:50 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:53:50 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:53:50 user nova-compute[73144]:       <source dev="/dev/sdf"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="vdc" bus="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <serial>8e6138b4-c75e-4c36-8cc4-c2500f228dab</serial>
Aug 14 21:53:50 user nova-compute[73144]:     </disk>
Aug 14 21:53:50 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:50 user nova-compute[73144]:       <mac address="fa:16:3e:c5:4b:7d"/>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="tapea4de1a3-ec"/>
Aug 14 21:53:50 user nova-compute[73144]:     </interface>
Aug 14 21:53:50 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:50 user nova-compute[73144]:       <mac address="fa:16:3e:94:d8:44"/>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="tapb4e21ba3-1d"/>
Aug 14 21:53:50 user nova-compute[73144]:     </interface>
Aug 14 21:53:50 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:50 user nova-compute[73144]:       <mac address="fa:16:3e:86:ab:2a"/>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="tapea49fecc-0b"/>
Aug 14 21:53:50 user nova-compute[73144]:     </interface>
Aug 14 21:53:50 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:50 user nova-compute[73144]:       <mac address="fa:16:3e:35:66:9b"/>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="tapfca1c03f-85"/>
Aug 14 21:53:50 user nova-compute[73144]:     </interface>
Aug 14 21:53:50 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:50 user nova-compute[73144]:       <mac address="fa:16:3e:cb:8e:27"/>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="tap4796b9c3-23"/>
Aug 14 21:53:50 user nova-compute[73144]:     </interface>
Aug 14 21:53:50 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:50 user nova-compute[73144]:       <mac address="fa:16:3e:05:e6:9e"/>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="tap48f70a89-3a"/>
Aug 14 21:53:50 user nova-compute[73144]:     </interface>
Aug 14 21:53:50 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:53:50 user nova-compute[73144]:       <mac address="fa:16:3e:fa:dd:c2"/>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:53:50 user nova-compute[73144]:       <target dev="tap935a7ffd-30"/>
Aug 14 21:53:50 user nova-compute[73144]:     </interface>
Aug 14 21:53:50 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:53:50 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c/console.log" append="off"/>
Aug 14 21:53:50 user nova-compute[73144]:     </serial>
Aug 14 21:53:50 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:53:50 user nova-compute[73144]:     <video>
Aug 14 21:53:50 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:53:50 user nova-compute[73144]:     </video>
Aug 14 21:53:50 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:53:50 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:53:50 user nova-compute[73144]:     </rng>
Aug 14 21:53:50 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:53:50 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:53:50 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:53:50 user nova-compute[73144]:     </memballoon>
Aug 14 21:53:50 user nova-compute[73144]:   </devices>
Aug 14 21:53:50 user nova-compute[73144]: </domain>
Aug 14 21:53:50 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=ea4de1a3-ece8-4141-b210-addf8b81a5ee,network=Network(5cdf94fe-3767-4925-b563-19c604cfb7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4de1a3-ec') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=ea4de1a3-ece8-4141-b210-addf8b81a5ee,network=Network(5cdf94fe-3767-4925-b563-19c604cfb7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4de1a3-ec') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea4de1a3-ec, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea4de1a3-ec, col_values=(('external_ids', {'iface-id': 'ea4de1a3-ece8-4141-b210-addf8b81a5ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:4b:7d', 'vm-uuid': '67dcd12b-616a-4f37-ad82-af85e2226b9c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: INFO os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=ea4de1a3-ece8-4141-b210-addf8b81a5ee,network=Network(5cdf94fe-3767-4925-b563-19c604cfb7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4de1a3-ec')
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:44,bridge_name='br-int',has_traffic_filtering=True,id=b4e21ba3-1dd5-4c3d-9572-28e009ce042c,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4e21ba3-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:44,bridge_name='br-int',has_traffic_filtering=True,id=b4e21ba3-1dd5-4c3d-9572-28e009ce042c,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4e21ba3-1d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4e21ba3-1d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4e21ba3-1d, col_values=(('external_ids', {'iface-id': 'b4e21ba3-1dd5-4c3d-9572-28e009ce042c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:d8:44', 'vm-uuid': '67dcd12b-616a-4f37-ad82-af85e2226b9c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: INFO os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:44,bridge_name='br-int',has_traffic_filtering=True,id=b4e21ba3-1dd5-4c3d-9572-28e009ce042c,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4e21ba3-1d')
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea49fecc-0b') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea49fecc-0b') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea49fecc-0b, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea49fecc-0b, col_values=(('external_ids', {'iface-id': 'ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ab:2a', 'vm-uuid': '67dcd12b-616a-4f37-ad82-af85e2226b9c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: INFO os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea49fecc-0b')
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:66:9b,bridge_name='br-int',has_traffic_filtering=True,id=fca1c03f-8518-4eed-a927-63c7e1c45b2d,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca1c03f-85') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:66:9b,bridge_name='br-int',has_traffic_filtering=True,id=fca1c03f-8518-4eed-a927-63c7e1c45b2d,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca1c03f-85') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfca1c03f-85, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfca1c03f-85, col_values=(('external_ids', {'iface-id': 'fca1c03f-8518-4eed-a927-63c7e1c45b2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:66:9b', 'vm-uuid': '67dcd12b-616a-4f37-ad82-af85e2226b9c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: INFO os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:66:9b,bridge_name='br-int',has_traffic_filtering=True,id=fca1c03f-8518-4eed-a927-63c7e1c45b2d,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca1c03f-85')
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8e:27,bridge_name='br-int',has_traffic_filtering=True,id=4796b9c3-23ac-4eec-8509-ffb653d10123,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4796b9c3-23') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8e:27,bridge_name='br-int',has_traffic_filtering=True,id=4796b9c3-23ac-4eec-8509-ffb653d10123,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4796b9c3-23') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4796b9c3-23, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4796b9c3-23, col_values=(('external_ids', {'iface-id': '4796b9c3-23ac-4eec-8509-ffb653d10123', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:8e:27', 'vm-uuid': '67dcd12b-616a-4f37-ad82-af85e2226b9c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: INFO os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8e:27,bridge_name='br-int',has_traffic_filtering=True,id=4796b9c3-23ac-4eec-8509-ffb653d10123,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4796b9c3-23')
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:9e,bridge_name='br-int',has_traffic_filtering=True,id=48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f70a89-3a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:9e,bridge_name='br-int',has_traffic_filtering=True,id=48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f70a89-3a') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48f70a89-3a, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48f70a89-3a, col_values=(('external_ids', {'iface-id': '48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:e6:9e', 'vm-uuid': '67dcd12b-616a-4f37-ad82-af85e2226b9c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: INFO os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:9e,bridge_name='br-int',has_traffic_filtering=True,id=48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f70a89-3a')
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:dd:c2,bridge_name='br-int',has_traffic_filtering=True,id=935a7ffd-3099-4412-98d4-be9ee95301dd,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935a7ffd-30') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:dd:c2,bridge_name='br-int',has_traffic_filtering=True,id=935a7ffd-3099-4412-98d4-be9ee95301dd,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935a7ffd-30') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap935a7ffd-30, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap935a7ffd-30, col_values=(('external_ids', {'iface-id': '935a7ffd-3099-4412-98d4-be9ee95301dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:dd:c2', 'vm-uuid': '67dcd12b-616a-4f37-ad82-af85e2226b9c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:50 user nova-compute[73144]: INFO os_vif [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:dd:c2,bridge_name='br-int',has_traffic_filtering=True,id=935a7ffd-3099-4412-98d4-be9ee95301dd,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935a7ffd-30')
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] No BDM found with device name hda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] No VIF found with MAC fa:16:3e:c5:4b:7d, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] No VIF found with MAC fa:16:3e:cb:8e:27, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:53:50 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Using config drive
Aug 14 21:53:50 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Creating config drive at /opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c/disk.config
Aug 14 21:53:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfvhaw_4_ {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfvhaw_4_" returned: 0 in 0.054s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-d436578c-741b-469d-b736-7c0e23b690f3 req-0eb02cb6-0148-40f5-9a7e-b390a368699b service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d436578c-741b-469d-b736-7c0e23b690f3 req-0eb02cb6-0148-40f5-9a7e-b390a368699b service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d436578c-741b-469d-b736-7c0e23b690f3 req-0eb02cb6-0148-40f5-9a7e-b390a368699b service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d436578c-741b-469d-b736-7c0e23b690f3 req-0eb02cb6-0148-40f5-9a7e-b390a368699b service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-d436578c-741b-469d-b736-7c0e23b690f3 req-0eb02cb6-0148-40f5-9a7e-b390a368699b service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:53 user nova-compute[73144]: WARNING nova.compute.manager [req-d436578c-741b-469d-b736-7c0e23b690f3 req-0eb02cb6-0148-40f5-9a7e-b390a368699b service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received unexpected event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with vm_state building and task_state spawning.
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-2e5bce7d-1df6-4d3b-b567-b1676f6033e4 req-08feea82-0957-45b8-bfe5-9f2f83c09a9c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2e5bce7d-1df6-4d3b-b567-b1676f6033e4 req-08feea82-0957-45b8-bfe5-9f2f83c09a9c service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2e5bce7d-1df6-4d3b-b567-b1676f6033e4 req-08feea82-0957-45b8-bfe5-9f2f83c09a9c service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2e5bce7d-1df6-4d3b-b567-b1676f6033e4 req-08feea82-0957-45b8-bfe5-9f2f83c09a9c service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-2e5bce7d-1df6-4d3b-b567-b1676f6033e4 req-08feea82-0957-45b8-bfe5-9f2f83c09a9c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:54 user nova-compute[73144]: WARNING nova.compute.manager [req-2e5bce7d-1df6-4d3b-b567-b1676f6033e4 req-08feea82-0957-45b8-bfe5-9f2f83c09a9c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d for instance with vm_state building and task_state spawning.
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-6def03f7-a2af-4734-b48f-b4bb54fd9288 req-902ec2e0-0ed9-47d4-afb4-d43ed1b0d2fa service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6def03f7-a2af-4734-b48f-b4bb54fd9288 req-902ec2e0-0ed9-47d4-afb4-d43ed1b0d2fa service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6def03f7-a2af-4734-b48f-b4bb54fd9288 req-902ec2e0-0ed9-47d4-afb4-d43ed1b0d2fa service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6def03f7-a2af-4734-b48f-b4bb54fd9288 req-902ec2e0-0ed9-47d4-afb4-d43ed1b0d2fa service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-6def03f7-a2af-4734-b48f-b4bb54fd9288 req-902ec2e0-0ed9-47d4-afb4-d43ed1b0d2fa service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:54 user nova-compute[73144]: WARNING nova.compute.manager [req-6def03f7-a2af-4734-b48f-b4bb54fd9288 req-902ec2e0-0ed9-47d4-afb4-d43ed1b0d2fa service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 for instance with vm_state building and task_state spawning.
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050034.8153229, db61b783-50d7-4304-a031-f9fb11069ef1 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:53:54 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] VM Resumed (Lifecycle Event)
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:53:54 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance spawned successfully.
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:54 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050034.8214602, db61b783-50d7-4304-a031-f9fb11069ef1 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:53:54 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] VM Started (Lifecycle Event)
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:53:54 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:53:54 user nova-compute[73144]: INFO nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Took 8.05 seconds to spawn the instance on the hypervisor.
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:54 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050019.9855886, 85862011-79d3-488f-885c-e4e907d8ed2f => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:53:54 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] VM Stopped (Lifecycle Event)
Aug 14 21:53:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5bff0199-f2f7-4c43-956c-cc372981a198 None None] [instance: 85862011-79d3-488f-885c-e4e907d8ed2f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:55 user nova-compute[73144]: INFO nova.compute.manager [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Took 8.84 seconds to build instance.
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-466e5329-258e-4372-9836-4c0126285b84 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.030s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:55 user nova-compute[73144]: INFO nova.compute.manager [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Terminating instance
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:55 user nova-compute[73144]: INFO nova.compute.manager [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Detaching volume 4e5d8bd2-73d2-48b1-9b99-32dca17dfde4
Aug 14 21:53:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:55 user nova-compute[73144]: WARNING nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received unexpected event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with vm_state active and task_state None.
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:55 user nova-compute[73144]: WARNING nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with vm_state building and task_state spawning.
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:55 user nova-compute[73144]: WARNING nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with vm_state building and task_state spawning.
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:55 user nova-compute[73144]: WARNING nova.compute.manager [req-2a1d0ff7-0dbe-48f3-a14d-e9a6546d54d3 req-3717ad0f-ea7d-490e-8d7e-ec0353f1a98a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c for instance with vm_state building and task_state spawning.
Aug 14 21:53:55 user nova-compute[73144]: INFO nova.virt.block_device [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Attempting to driver detach volume 4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 from mountpoint /dev/vdb
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Attempting to detach device vdb from instance ea802951-a15c-4dac-a693-4fe96ef3cc9f from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:53:56 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:53:56 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:53:56 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:53:56 user nova-compute[73144]:   <serial>4e5d8bd2-73d2-48b1-9b99-32dca17dfde4</serial>
Aug 14 21:53:56 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 21:53:56 user nova-compute[73144]: </disk>
Aug 14 21:53:56 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:53:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully detached device vdb from instance ea802951-a15c-4dac-a693-4fe96ef3cc9f from the persistent domain config.
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea802951-a15c-4dac-a693-4fe96ef3cc9f from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:53:56 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:53:56 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:53:56 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:53:56 user nova-compute[73144]:   <serial>4e5d8bd2-73d2-48b1-9b99-32dca17dfde4</serial>
Aug 14 21:53:56 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 21:53:56 user nova-compute[73144]: </disk>
Aug 14 21:53:56 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-6e78c7b5-c430-47cb-b6d0-629e23cdf4d5 req-a5585edb-85f4-4c68-b75c-7cdbed222743 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6e78c7b5-c430-47cb-b6d0-629e23cdf4d5 req-a5585edb-85f4-4c68-b75c-7cdbed222743 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6e78c7b5-c430-47cb-b6d0-629e23cdf4d5 req-a5585edb-85f4-4c68-b75c-7cdbed222743 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6e78c7b5-c430-47cb-b6d0-629e23cdf4d5 req-a5585edb-85f4-4c68-b75c-7cdbed222743 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-6e78c7b5-c430-47cb-b6d0-629e23cdf4d5 req-a5585edb-85f4-4c68-b75c-7cdbed222743 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:56 user nova-compute[73144]: WARNING nova.compute.manager [req-6e78c7b5-c430-47cb-b6d0-629e23cdf4d5 req-a5585edb-85f4-4c68-b75c-7cdbed222743 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d for instance with vm_state building and task_state spawning.
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-be0014b1-419f-48b6-834d-3bd4dabac54b req-c494df81-2931-4a4a-a5b7-0065e2291455 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be0014b1-419f-48b6-834d-3bd4dabac54b req-c494df81-2931-4a4a-a5b7-0065e2291455 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be0014b1-419f-48b6-834d-3bd4dabac54b req-c494df81-2931-4a4a-a5b7-0065e2291455 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be0014b1-419f-48b6-834d-3bd4dabac54b req-c494df81-2931-4a4a-a5b7-0065e2291455 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-be0014b1-419f-48b6-834d-3bd4dabac54b req-c494df81-2931-4a4a-a5b7-0065e2291455 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:56 user nova-compute[73144]: WARNING nova.compute.manager [req-be0014b1-419f-48b6-834d-3bd4dabac54b req-c494df81-2931-4a4a-a5b7-0065e2291455 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 for instance with vm_state building and task_state spawning.
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050036.851004, ea802951-a15c-4dac-a693-4fe96ef3cc9f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:53:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully detached device vdb from instance ea802951-a15c-4dac-a693-4fe96ef3cc9f from the live domain config.
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'njWFHoVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Instance destroyed successfully.
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.objects.instance [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lazy-loading 'resources' on Instance uuid abb6bbee-268b-45c6-b3da-49ecc86944c0 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535c2ee-aeab-4346-8219-f158059fea1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-504781444',display_name='tempest-ServerActionsTestOtherB-server-504781444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-504781444',id=5,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfV6sgQgTCYQNdDjYIT+bEim/Y3rwaFXkgUssThzRJl4shQWNyusJaVOZ4b3wOZ1adxwKBMgJA5qAEXDpTVVzwST1TNgDaV4O7P+DlcIb/Iw9odXA8RDGeZw9jCXcGP5Q==',key_name='tempest-keypair-1302670352',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3eaba4f7824769adb0e2a2a28f3924',ramdisk_id='',reservation_id='r-0a8w6mdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-679953584',owner_user_name='tempest-ServerActionsTestOtherB-679953584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24af35347484e5982207ed21f62bc2a',uuid=abb6bbee-268b-45c6-b3da-49ecc86944c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converting VIF {"id": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "address": "fa:16:3e:74:a7:97", "network": {"id": "971e8d26-c3e2-48da-bc02-0d4361759fee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-476370894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3eaba4f7824769adb0e2a2a28f3924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758cbe79-b4", "ovs_interfaceid": "758cbe79-b4b9-40b7-93a4-37b07664efb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_vif [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap758cbe79-b4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:56 user nova-compute[73144]: INFO os_vif [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a7:97,bridge_name='br-int',has_traffic_filtering=True,id=758cbe79-b4b9-40b7-93a4-37b07664efb4,network=Network(971e8d26-c3e2-48da-bc02-0d4361759fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758cbe79-b4')
Aug 14 21:53:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTYcpkGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:53:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[958b5ba8-e7ce-4863-bbed-c86c8077a9a2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:53:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:56 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:53:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17865dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4645eb7c-69ae-4505-a58b-5a661a9d85f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[59df3492-c95b-479e-b86b-a8e6258b2c03]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:53:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f286944d-997b-4e8d-a6bf-14743a93fd43]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2906bd8-04d9-42e3-8354-484fc6db08ff]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001abd5-1ba8-4050-b2e3-0ff8daaf1404]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[645282c2-5b7b-4549-aff4-5301a2ed8b4f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260]
Aug 14 21:53:57 user nova-compute[73144]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4, portal: 172.16.0.220,3260] successful.
Aug 14 21:53:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e5d8bd2-73d2-48b1-9b99-32dca17dfde4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab79922-d2df-4304-9c7b-259ef1bb85c7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== disconnect_volume: return (394ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.345s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[917a57ec-eaf7-4bc5-8e3f-bd05e7b721da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19e7fe-ec3c-4331-a4e9-b6489cf4d2a2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:57 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:57 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:57 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:53:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 (non-flash)
Aug 14 21:53:57 user nova-compute[73144]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:53:57 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:53:57 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:53:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586ba200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef49f1-d05a-43c1-a0d5-f51c58efb310]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b82318-5a1e-4878-99c0-d373534eb49d]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b96b20-a48b-461c-8a7a-9c0d068d8be8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ceebc5-76e9-4727-a701-33ee019b473b]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f2bbcd-6cfe-4d2c-9e24-c839a2cc1ba2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[113991d9-7980-4121-a169-25584dd588e0]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260]
Aug 14 21:53:57 user nova-compute[73144]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329, portal: 172.16.0.220,3260] successful.
Aug 14 21:53:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e42c18f-690a-4fd0-a365-b8e7bbbf4329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffc0899-3532-4ab0-87ee-822307bb35cd]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] <== disconnect_volume: return (747ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Deleting instance files /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0_del
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Deletion of /opt/stack/data/nova/instances/abb6bbee-268b-45c6-b3da-49ecc86944c0_del complete
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050037.7043717, 67dcd12b-616a-4f37-ad82-af85e2226b9c => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] VM Resumed (Lifecycle Event)
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance spawned successfully.
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050037.7074885, 67dcd12b-616a-4f37-ad82-af85e2226b9c => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] VM Started (Lifecycle Event)
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.compute.manager [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Took 2.18 seconds to destroy the instance on the hypervisor.
Aug 14 21:53:57 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:53:57 user nova-compute[73144]: INFO nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Took 12.51 seconds to spawn the instance on the hypervisor.
Aug 14 21:53:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:58 user nova-compute[73144]: WARNING nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c for instance with vm_state building and task_state spawning.
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:58 user nova-compute[73144]: WARNING nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 for instance with vm_state building and task_state spawning.
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:53:58 user nova-compute[73144]: WARNING nova.compute.manager [req-41724ea0-2df3-427e-b471-2c49ef4dd9bc req-4269cb85-662f-4823-9685-cce634d88a52 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 for instance with vm_state building and task_state spawning.
Aug 14 21:53:58 user nova-compute[73144]: INFO nova.compute.manager [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Took 51.43 seconds to build instance.
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f5d8b62e-e6db-423c-8383-323a156c949c tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.581s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.objects.instance [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'flavor' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-80cdbb2c-4004-4f9a-9a29-a3ac740c01f3 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.471s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:53:59 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Took 1.42 seconds to deallocate network for instance.
Aug 14 21:53:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-2bd991a2-475e-43d2-a202-a155cc0cca63 req-09b53182-b2ea-4caf-8501-dde0bcf8cc94 service nova] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Received event network-vif-deleted-758cbe79-b4b9-40b7-93a4-37b07664efb4 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:53:59 user nova-compute[73144]: INFO nova.compute.claims [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Claim successful on node user
Aug 14 21:53:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:53:59 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:00 user nova-compute[73144]: WARNING nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 for instance with vm_state active and task_state None.
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:00 user nova-compute[73144]: WARNING nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 for instance with vm_state active and task_state None.
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:00 user nova-compute[73144]: WARNING nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd for instance with vm_state active and task_state None.
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:00 user nova-compute[73144]: WARNING nova.compute.manager [req-a6180955-d5c3-4b9a-885b-2fda5a417fb3 req-60e78bc8-87e7-4d86-b4fa-b1eea8184951 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd for instance with vm_state active and task_state None.
Aug 14 21:54:00 user nova-compute[73144]: INFO nova.compute.manager [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Took 0.97 seconds to detach 1 volumes for instance.
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.network.neutron [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:54:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:54:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Creating image(s)
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "/opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "/opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "/opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.policy [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb1f449772884d49a1d6355fd3c49908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3174ac5ed0da4e0faa1404a52ccc760f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.248s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGZDbQBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:54:00 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:54:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:54:00 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:54:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:54:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:54:00 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:54:00 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad09f9-aa05-4112-b068-a29c11f7ca79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:54:01 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.617s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a74e8eb-a227-4dfb-b3b8-231c636de48b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a] added
Aug 14 21:54:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Deleted allocations for instance abb6bbee-268b-45c6-b3da-49ecc86944c0
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8044ea-9fca-4624-9bb9-bc6f87c3c7f5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk 1073741824" returned: 0 in 0.071s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd55b5f-1f1a-4d5a-8b41-c01add246b0a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGZDbQBh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGZDbQBh" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b144d4c0-69b7-428e-84f3-081941266dc5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qGZDbQBh'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab1e52-b2d4-4a44-a5fb-a219390ff65f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-67731808-b9ce-4478-b5ec-7d5047ae76d2 tempest-ServerActionsTestOtherB-679953584 tempest-ServerActionsTestOtherB-679953584-project-member] Lock "abb6bbee-268b-45c6-b3da-49ecc86944c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.601s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eff3ad-367f-45a0-a538-c9e234b2dbca]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fc49d1-1db2-4523-8a08-266d10f20a12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260]
Aug 14 21:54:01 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260] successful.
Aug 14 21:54:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf516d7-a547-4d8c-bd5c-6a3c52d860d2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[726dd55c-422c-4699-9938-2b3699947538]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a (non-flash)
Aug 14 21:54:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:01 user nova-compute[73144]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a (non-flash)
Aug 14 21:54:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.334s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0c3f5f-d92a-4ffd-ab4e-a406364fd08f]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGZDbQBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG nova.network.neutron [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Successfully created port: 25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Cannot resize image /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG nova.objects.instance [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lazy-loading 'migration_context' on Instance uuid 89f447d4-22b3-42f7-8830-9facdce3412c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Ensure instance console log exists: /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.564s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== connect_volume: return (1566ms) {'type': 'block', 'scsi_wwn': '26638373833343139', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638373833343139', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid 97776072-7d34-4549-8f2e-bc01db5cba92 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.network.neutron [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Successfully updated port: 25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:54:02 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:54:02 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:54:02 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:54:02 user nova-compute[73144]:   <serial>07ad9b33-bb1d-4bbe-bc76-9e0ecada908a</serial>
Aug 14 21:54:02 user nova-compute[73144]: </disk>
Aug 14 21:54:02 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquired lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.network.neutron [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-changed-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Refreshing instance network info cache due to event network-changed-25845491-fe11-4220-8641-c32668bd0b0f. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] Acquiring lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.network.neutron [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.network.neutron [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating instance_info_cache with network_info: [{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:54:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No VIF found with MAC fa:16:3e:3a:75:2c, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Releasing lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Instance network_info: |[{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] Acquired lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Refreshing network info cache for port 25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Start _get_guest_xml network_info=[{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:54:03 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:03 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1409180542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1409180542',id=25,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4t1KtQofX0cMHM3SICsEr2rAdfaE2wiR8BSrzG9+tLGnzk41OqtFUGWr3xM3tag2vxhJoRBCrkHCi8hXw+jUkNYteMdeO7EQMQEcKMBf7Jl6VoLwsx58KOeQPHByasDA==',key_name='tempest-keypair-722661810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3174ac5ed0da4e0faa1404a52ccc760f',ramdisk_id='',reservation_id='r-oswh5u0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-643572001',owner_user_name='tempest-TaggedAttachmentsTest-643572001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1f449772884d49a1d6355fd3c49908',uuid=89f447d4-22b3-42f7-8830-9facdce3412c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converting VIF {"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:d0,bridge_name='br-int',has_traffic_filtering=True,id=25845491-fe11-4220-8641-c32668bd0b0f,network=Network(5f5f4c34-7b3e-4007-a54d-ffac230af0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25845491-fe') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.objects.instance [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lazy-loading 'pci_devices' on Instance uuid 89f447d4-22b3-42f7-8830-9facdce3412c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:54:03 user nova-compute[73144]:   <uuid>89f447d4-22b3-42f7-8830-9facdce3412c</uuid>
Aug 14 21:54:03 user nova-compute[73144]:   <name>instance-00000019</name>
Aug 14 21:54:03 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:54:03 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:54:03 user nova-compute[73144]:   <metadata>
Aug 14 21:54:03 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:54:03 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:54:03 user nova-compute[73144]:       <nova:name>tempest-device-tagging-server-1409180542</nova:name>
Aug 14 21:54:03 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:54:03</nova:creationTime>
Aug 14 21:54:03 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:54:03 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:54:03 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:54:03 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:54:03 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:54:03 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:54:03 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:54:03 user nova-compute[73144]:       <nova:owner>
Aug 14 21:54:03 user nova-compute[73144]:         <nova:user uuid="bb1f449772884d49a1d6355fd3c49908">tempest-TaggedAttachmentsTest-643572001-project-member</nova:user>
Aug 14 21:54:03 user nova-compute[73144]:         <nova:project uuid="3174ac5ed0da4e0faa1404a52ccc760f">tempest-TaggedAttachmentsTest-643572001</nova:project>
Aug 14 21:54:03 user nova-compute[73144]:       </nova:owner>
Aug 14 21:54:03 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:54:03 user nova-compute[73144]:       <nova:ports>
Aug 14 21:54:03 user nova-compute[73144]:         <nova:port uuid="25845491-fe11-4220-8641-c32668bd0b0f">
Aug 14 21:54:03 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 21:54:03 user nova-compute[73144]:         </nova:port>
Aug 14 21:54:03 user nova-compute[73144]:       </nova:ports>
Aug 14 21:54:03 user nova-compute[73144]:     </nova:instance>
Aug 14 21:54:03 user nova-compute[73144]:   </metadata>
Aug 14 21:54:03 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:54:03 user nova-compute[73144]:     <system>
Aug 14 21:54:03 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:54:03 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:54:03 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:54:03 user nova-compute[73144]:       <entry name="serial">89f447d4-22b3-42f7-8830-9facdce3412c</entry>
Aug 14 21:54:03 user nova-compute[73144]:       <entry name="uuid">89f447d4-22b3-42f7-8830-9facdce3412c</entry>
Aug 14 21:54:03 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:54:03 user nova-compute[73144]:     </system>
Aug 14 21:54:03 user nova-compute[73144]:   </sysinfo>
Aug 14 21:54:03 user nova-compute[73144]:   <os>
Aug 14 21:54:03 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:54:03 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:54:03 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:54:03 user nova-compute[73144]:   </os>
Aug 14 21:54:03 user nova-compute[73144]:   <features>
Aug 14 21:54:03 user nova-compute[73144]:     <acpi/>
Aug 14 21:54:03 user nova-compute[73144]:     <apic/>
Aug 14 21:54:03 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:54:03 user nova-compute[73144]:   </features>
Aug 14 21:54:03 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:54:03 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:54:03 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:54:03 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:54:03 user nova-compute[73144]:   </clock>
Aug 14 21:54:03 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:54:03 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:54:03 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:54:03 user nova-compute[73144]:   </cpu>
Aug 14 21:54:03 user nova-compute[73144]:   <devices>
Aug 14 21:54:03 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:54:03 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:54:03 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk"/>
Aug 14 21:54:03 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:54:03 user nova-compute[73144]:     </disk>
Aug 14 21:54:03 user nova-compute[73144]:     <disk type="file" device="cdrom">
Aug 14 21:54:03 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 21:54:03 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk.config"/>
Aug 14 21:54:03 user nova-compute[73144]:       <target dev="hda" bus="ide"/>
Aug 14 21:54:03 user nova-compute[73144]:     </disk>
Aug 14 21:54:03 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:54:03 user nova-compute[73144]:       <mac address="fa:16:3e:2b:af:d0"/>
Aug 14 21:54:03 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:54:03 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:54:03 user nova-compute[73144]:       <target dev="tap25845491-fe"/>
Aug 14 21:54:03 user nova-compute[73144]:     </interface>
Aug 14 21:54:03 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:54:03 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/console.log" append="off"/>
Aug 14 21:54:03 user nova-compute[73144]:     </serial>
Aug 14 21:54:03 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:54:03 user nova-compute[73144]:     <video>
Aug 14 21:54:03 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:54:03 user nova-compute[73144]:     </video>
Aug 14 21:54:03 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:54:03 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:54:03 user nova-compute[73144]:     </rng>
Aug 14 21:54:03 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:54:03 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:54:03 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:54:03 user nova-compute[73144]:     </memballoon>
Aug 14 21:54:03 user nova-compute[73144]:   </devices>
Aug 14 21:54:03 user nova-compute[73144]: </domain>
Aug 14 21:54:03 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1409180542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1409180542',id=25,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4t1KtQofX0cMHM3SICsEr2rAdfaE2wiR8BSrzG9+tLGnzk41OqtFUGWr3xM3tag2vxhJoRBCrkHCi8hXw+jUkNYteMdeO7EQMQEcKMBf7Jl6VoLwsx58KOeQPHByasDA==',key_name='tempest-keypair-722661810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3174ac5ed0da4e0faa1404a52ccc760f',ramdisk_id='',reservation_id='r-oswh5u0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-643572001',owner_user_name='tempest-TaggedAttachmentsTest-643572001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1f449772884d49a1d6355fd3c49908',uuid=89f447d4-22b3-42f7-8830-9facdce3412c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converting VIF {"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:d0,bridge_name='br-int',has_traffic_filtering=True,id=25845491-fe11-4220-8641-c32668bd0b0f,network=Network(5f5f4c34-7b3e-4007-a54d-ffac230af0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25845491-fe') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG os_vif [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:d0,bridge_name='br-int',has_traffic_filtering=True,id=25845491-fe11-4220-8641-c32668bd0b0f,network=Network(5f5f4c34-7b3e-4007-a54d-ffac230af0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25845491-fe') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25845491-fe, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25845491-fe, col_values=(('external_ids', {'iface-id': '25845491-fe11-4220-8641-c32668bd0b0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:af:d0', 'vm-uuid': '89f447d4-22b3-42f7-8830-9facdce3412c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:03 user nova-compute[73144]: INFO os_vif [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:d0,bridge_name='br-int',has_traffic_filtering=True,id=25845491-fe11-4220-8641-c32668bd0b0f,network=Network(5f5f4c34-7b3e-4007-a54d-ffac230af0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25845491-fe')
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] No BDM found with device name hda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] No VIF found with MAC fa:16:3e:2b:af:d0, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:54:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Using config drive
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f18fadd-e585-4ad9-ae39-520dcb556ad0 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.566s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Creating config drive at /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk.config
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpag_wgqhy {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpag_wgqhy" returned: 0 in 0.076s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updated VIF entry in instance network info cache for port 25845491-fe11-4220-8641-c32668bd0b0f. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating instance_info_cache with network_info: [{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:54:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a04c4908-4715-4c3c-afa9-d4976c8ad29f req-cab2bec7-4694-4e8d-97cd-4b88cd262f4d service nova] Releasing lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:54:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:04 user nova-compute[73144]: INFO nova.compute.manager [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Detaching volume 07ad9b33-bb1d-4bbe-bc76-9e0ecada908a
Aug 14 21:54:04 user nova-compute[73144]: INFO nova.virt.block_device [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Attempting to driver detach volume 07ad9b33-bb1d-4bbe-bc76-9e0ecada908a from mountpoint /dev/vdb
Aug 14 21:54:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Attempting to detach device vdb from instance 97776072-7d34-4549-8f2e-bc01db5cba92 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:54:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:54:04 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:54:04 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:54:04 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:54:04 user nova-compute[73144]:   <serial>07ad9b33-bb1d-4bbe-bc76-9e0ecada908a</serial>
Aug 14 21:54:04 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:54:04 user nova-compute[73144]: </disk>
Aug 14 21:54:04 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:54:04 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully detached device vdb from instance 97776072-7d34-4549-8f2e-bc01db5cba92 from the persistent domain config.
Aug 14 21:54:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97776072-7d34-4549-8f2e-bc01db5cba92 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:54:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:54:04 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:54:04 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 21:54:04 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:54:04 user nova-compute[73144]:   <serial>07ad9b33-bb1d-4bbe-bc76-9e0ecada908a</serial>
Aug 14 21:54:04 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:54:04 user nova-compute[73144]: </disk>
Aug 14 21:54:04 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050045.4949546, 97776072-7d34-4549-8f2e-bc01db5cba92 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97776072-7d34-4549-8f2e-bc01db5cba92 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:54:05 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully detached device vdb from instance 97776072-7d34-4549-8f2e-bc01db5cba92 from the live domain config.
Aug 14 21:54:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGZDbQBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:54:05 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-badde175-5f3e-4705-a826-9abb3f692a41 req-4bb67c9d-3069-46f6-89f4-66d86057a8cf service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-badde175-5f3e-4705-a826-9abb3f692a41 req-4bb67c9d-3069-46f6-89f4-66d86057a8cf service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-badde175-5f3e-4705-a826-9abb3f692a41 req-4bb67c9d-3069-46f6-89f4-66d86057a8cf service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-badde175-5f3e-4705-a826-9abb3f692a41 req-4bb67c9d-3069-46f6-89f4-66d86057a8cf service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-badde175-5f3e-4705-a826-9abb3f692a41 req-4bb67c9d-3069-46f6-89f4-66d86057a8cf service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:05 user nova-compute[73144]: WARNING nova.compute.manager [req-badde175-5f3e-4705-a826-9abb3f692a41 req-4bb67c9d-3069-46f6-89f4-66d86057a8cf service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received unexpected event network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f for instance with vm_state building and task_state spawning.
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.048s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[36896122-51ab-41ea-b331-988e45bf74b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[886a0ed9-ac8b-4759-a0cf-1ad86b6e888d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:05 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:05 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:05 user nova-compute[73144]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a (non-flash)
Aug 14 21:54:05 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:05 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:05 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:05 user nova-compute[73144]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a (non-flash)
Aug 14 21:54:05 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa178509750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f3341-a5dc-4e70-b773-de491a5a5bac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ee463-b71b-4963-888d-fa559ee0797b]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf5d79a-3a6c-4a33-b2f6-fdfeb677c8fd]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdea4af-374b-4dc5-a4d4-1699c7667059]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01bc8d-0aa8-4df0-9cc3-ddf00457433c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:05 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:54:05 user nova-compute[73144]: INFO nova.compute.claims [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Claim successful on node user
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa7d5f-5ef4-4d21-b272-738c2c056ac5]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260]
Aug 14 21:54:06 user nova-compute[73144]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a, portal: 172.16.0.220,3260] successful.
Aug 14 21:54:06 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07ad9b33-bb1d-4bbe-bc76-9e0ecada908a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b59bd2-4e49-4aa8-a65d-ce67c9ae4735]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.474s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== disconnect_volume: return (476ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:54:06 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:54:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:54:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG nova.policy [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe8b1fc0405438c99d3edd956e103a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e45dfdc13e486e950f6bc8595bb8fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid 97776072-7d34-4549-8f2e-bc01db5cba92 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:07 user nova-compute[73144]: INFO nova.virt.block_device [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Booting with blank volume at /dev/vda
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7f945596-ab87-4e45-b995-593da44dcd46 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.817s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-8e8322d8-5575-4d8b-80ce-8ae4278f201b req-d71621a2-5c0e-4c28-b4f9-e5c8a89feefe service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8e8322d8-5575-4d8b-80ce-8ae4278f201b req-d71621a2-5c0e-4c28-b4f9-e5c8a89feefe service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8e8322d8-5575-4d8b-80ce-8ae4278f201b req-d71621a2-5c0e-4c28-b4f9-e5c8a89feefe service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8e8322d8-5575-4d8b-80ce-8ae4278f201b req-d71621a2-5c0e-4c28-b4f9-e5c8a89feefe service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-8e8322d8-5575-4d8b-80ce-8ae4278f201b req-d71621a2-5c0e-4c28-b4f9-e5c8a89feefe service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:07 user nova-compute[73144]: WARNING nova.compute.manager [req-8e8322d8-5575-4d8b-80ce-8ae4278f201b req-d71621a2-5c0e-4c28-b4f9-e5c8a89feefe service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received unexpected event network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f for instance with vm_state building and task_state spawning.
Aug 14 21:54:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Successfully created port: b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050048.298754, 89f447d4-22b3-42f7-8830-9facdce3412c => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:54:08 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] VM Resumed (Lifecycle Event)
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Instance spawned successfully.
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:08 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050048.302401, 89f447d4-22b3-42f7-8830-9facdce3412c => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:54:08 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] VM Started (Lifecycle Event)
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:54:08 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:54:08 user nova-compute[73144]: INFO nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:08 user nova-compute[73144]: INFO nova.compute.manager [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Took 9.31 seconds to build instance.
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09b62f16-e7c7-4aeb-a993-63abe3f344b4 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.474s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Successfully updated port: b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:54:08 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-changed-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Refreshing instance network info cache due to event network-changed-b3326f41-f503-40b1-a924-be55d27143a1. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] Acquiring lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance network_info: |[{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] Acquired lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG nova.network.neutron [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Refreshing network info cache for port b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG nova.network.neutron [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updated VIF entry in instance network info cache for port b3326f41-f503-40b1-a924-be55d27143a1. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG nova.network.neutron [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-de9ed9ca-9e8d-4eb6-8807-e40c68069668 req-38adecf0-0648-4c8a-af9e-140e0c8511cb service nova] Releasing lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:54:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050036.882959, abb6bbee-268b-45c6-b3da-49ecc86944c0 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:54:12 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] VM Stopped (Lifecycle Event)
Aug 14 21:54:12 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:12 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7434MB free_disk=25.441211700439453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a452f6cb-4500-4982-8f63-793d1751943a None None] [instance: abb6bbee-268b-45c6-b3da-49ecc86944c0] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5fb72bd6-7deb-4a48-b1ef-410911faec15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ea802951-a15c-4dac-a693-4fe96ef3cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 97776072-7d34-4549-8f2e-bc01db5cba92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 67dcd12b-616a-4f37-ad82-af85e2226b9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance db61b783-50d7-4304-a031-f9fb11069ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 89f447d4-22b3-42f7-8830-9facdce3412c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:54:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG os_brick.utils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3687f986-c9b2-4000-a6d5-0ee60bb2a1c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[87734450-e970-4e69-9eac-e2db37df1885]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7073d8b-92aa-4677-8155-19f97d2b88cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[89741f58-7e6a-4280-990b-c52d938ba384]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:54:13 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:54:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3990f26a-566f-4735-9f5d-4ef92d4a680b]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG os_brick.utils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:54:13 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating existing volume attachment record: db67e0ac-5dfa-4ca8-b56a-34b021079d3b {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:54:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:54:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:54:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:54:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:54:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:54:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:54:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:54:21 user nova-compute[73144]: INFO nova.compute.claims [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Claim successful on node user
Aug 14 21:54:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:54:21 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.policy [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b412578d976492cb05f9b674422687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94f10ae206741b9b6e08ef94ea04537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:54:21 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Creating image(s)
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "/opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "/opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.225s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.280s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk 1073741824" returned: 0 in 0.049s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Successfully created port: 6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Cannot resize image /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'migration_context' on Instance uuid 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Ensure instance console log exists: /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:54:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Creating image(s)
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Ensure instance console log exists: /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Start _get_guest_xml network_info=[{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'db67e0ac-5dfa-4ca8-b56a-34b021079d3b', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPABoKSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5229a303-2dad-45a6-b140-29a55d8d29a7', 'attached_at': '', 'detached_at': '', 'volume_id': '87b56623-f20c-428c-9ea2-ac2f0eeba823', 'serial': '87b56623-f20c-428c-9ea2-ac2f0eeba823'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:54:22 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:22 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPABoKSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:54:22 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:54:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:54:22 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:54:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:54:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:54:22 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:54:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95806ff-2f55-497c-b258-1be3f4f41521]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:54:23 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc40aea-d85a-4e1c-a252-c09dd66e1ed8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823] added
Aug 14 21:54:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8fbc2-ae2a-48e2-97b0-7ab08b3be72e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[130d2762-64a6-44d1-85f3-4a0105ad0512]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPABoKSl {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPABoKSl" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a052d7-6dac-45ab-adba-f65e25bea6c9]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPABoKSl'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb7d650-7589-43ea-88d9-9e69f014033b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[829dbefb-9c0f-456d-8c21-17119908b220]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Successfully updated port: 6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquired lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[99864ea4-a927-42f6-a284-c81db0de18c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260]
Aug 14 21:54:23 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260] successful.
Aug 14 21:54:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-changed-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Refreshing instance network info cache due to event network-changed-6b98003c-89e7-4f8a-a57c-426f0dab822a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] Acquiring lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f617c68-5055-4e33-a5b8-224d76e1bd67]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9b771-4659-4041-a4f6-ddb1eb0bf154]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:54:23 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:54:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fba714-251c-4001-b60d-095296b15b56]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPABoKSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updating instance_info_cache with network_info: [{"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Releasing lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Instance network_info: |[{"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] Acquired lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Refreshing network info cache for port 6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Start _get_guest_xml network_info=[{"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:54:23 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:23 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:54:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1075166230',display_name='tempest-TestStampPattern-server-1075166230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1075166230',id=27,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo+Eu6fj6m04L/OHnRQniRF3Yy0E2Y3eNFOhLDS/TGnK4cUO2zCBraPB+7Labc3TI7bXn/UiCDNG8VquktTfLQx3I7Xh7zvPhR0fzTI8bJ9GlpyZ8Xst4GgNE/zOTx0nA==',key_name='tempest-TestStampPattern-973921468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d94f10ae206741b9b6e08ef94ea04537',ramdisk_id='',reservation_id='r-5agwcs3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069970921',owner_user_name='tempest-TestStampPattern-2069970921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:54:22Z,user_data=None,user_id='0b412578d976492cb05f9b674422687e',uuid=4c8d3ab9-801b-41ba-ad20-2e202eccf0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converting VIF {"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:a5,bridge_name='br-int',has_traffic_filtering=True,id=6b98003c-89e7-4f8a-a57c-426f0dab822a,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b98003c-89') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:54:23 user nova-compute[73144]:   <uuid>4c8d3ab9-801b-41ba-ad20-2e202eccf0e7</uuid>
Aug 14 21:54:23 user nova-compute[73144]:   <name>instance-0000001b</name>
Aug 14 21:54:23 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:54:23 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:54:23 user nova-compute[73144]:   <metadata>
Aug 14 21:54:23 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:54:23 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:54:23 user nova-compute[73144]:       <nova:name>tempest-TestStampPattern-server-1075166230</nova:name>
Aug 14 21:54:23 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:54:23</nova:creationTime>
Aug 14 21:54:23 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:54:23 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:54:23 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:54:23 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:54:23 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:54:23 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:54:23 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:54:23 user nova-compute[73144]:       <nova:owner>
Aug 14 21:54:23 user nova-compute[73144]:         <nova:user uuid="0b412578d976492cb05f9b674422687e">tempest-TestStampPattern-2069970921-project-member</nova:user>
Aug 14 21:54:23 user nova-compute[73144]:         <nova:project uuid="d94f10ae206741b9b6e08ef94ea04537">tempest-TestStampPattern-2069970921</nova:project>
Aug 14 21:54:23 user nova-compute[73144]:       </nova:owner>
Aug 14 21:54:23 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:54:23 user nova-compute[73144]:       <nova:ports>
Aug 14 21:54:23 user nova-compute[73144]:         <nova:port uuid="6b98003c-89e7-4f8a-a57c-426f0dab822a">
Aug 14 21:54:23 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 21:54:23 user nova-compute[73144]:         </nova:port>
Aug 14 21:54:23 user nova-compute[73144]:       </nova:ports>
Aug 14 21:54:23 user nova-compute[73144]:     </nova:instance>
Aug 14 21:54:23 user nova-compute[73144]:   </metadata>
Aug 14 21:54:23 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:54:23 user nova-compute[73144]:     <system>
Aug 14 21:54:23 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:54:23 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:54:23 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:54:23 user nova-compute[73144]:       <entry name="serial">4c8d3ab9-801b-41ba-ad20-2e202eccf0e7</entry>
Aug 14 21:54:23 user nova-compute[73144]:       <entry name="uuid">4c8d3ab9-801b-41ba-ad20-2e202eccf0e7</entry>
Aug 14 21:54:23 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:54:23 user nova-compute[73144]:     </system>
Aug 14 21:54:23 user nova-compute[73144]:   </sysinfo>
Aug 14 21:54:23 user nova-compute[73144]:   <os>
Aug 14 21:54:23 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:54:23 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:54:23 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:54:23 user nova-compute[73144]:   </os>
Aug 14 21:54:23 user nova-compute[73144]:   <features>
Aug 14 21:54:23 user nova-compute[73144]:     <acpi/>
Aug 14 21:54:23 user nova-compute[73144]:     <apic/>
Aug 14 21:54:23 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:54:23 user nova-compute[73144]:   </features>
Aug 14 21:54:23 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:54:23 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:54:23 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:54:23 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:54:23 user nova-compute[73144]:   </clock>
Aug 14 21:54:23 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:54:23 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:54:23 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:54:23 user nova-compute[73144]:   </cpu>
Aug 14 21:54:23 user nova-compute[73144]:   <devices>
Aug 14 21:54:23 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:54:23 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:54:23 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk"/>
Aug 14 21:54:23 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:54:23 user nova-compute[73144]:     </disk>
Aug 14 21:54:23 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:54:23 user nova-compute[73144]:       <mac address="fa:16:3e:13:43:a5"/>
Aug 14 21:54:23 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:54:23 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:54:23 user nova-compute[73144]:       <target dev="tap6b98003c-89"/>
Aug 14 21:54:23 user nova-compute[73144]:     </interface>
Aug 14 21:54:23 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:54:23 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/console.log" append="off"/>
Aug 14 21:54:23 user nova-compute[73144]:     </serial>
Aug 14 21:54:23 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:54:23 user nova-compute[73144]:     <video>
Aug 14 21:54:23 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:54:23 user nova-compute[73144]:     </video>
Aug 14 21:54:23 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:54:23 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:54:23 user nova-compute[73144]:     </rng>
Aug 14 21:54:23 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:54:23 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:54:23 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:54:23 user nova-compute[73144]:     </memballoon>
Aug 14 21:54:23 user nova-compute[73144]:   </devices>
Aug 14 21:54:23 user nova-compute[73144]: </domain>
Aug 14 21:54:23 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:54:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1075166230',display_name='tempest-TestStampPattern-server-1075166230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1075166230',id=27,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo+Eu6fj6m04L/OHnRQniRF3Yy0E2Y3eNFOhLDS/TGnK4cUO2zCBraPB+7Labc3TI7bXn/UiCDNG8VquktTfLQx3I7Xh7zvPhR0fzTI8bJ9GlpyZ8Xst4GgNE/zOTx0nA==',key_name='tempest-TestStampPattern-973921468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d94f10ae206741b9b6e08ef94ea04537',ramdisk_id='',reservation_id='r-5agwcs3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069970921',owner_user_name='tempest-TestStampPattern-2069970921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:54:22Z,user_data=None,user_id='0b412578d976492cb05f9b674422687e',uuid=4c8d3ab9-801b-41ba-ad20-2e202eccf0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converting VIF {"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:a5,bridge_name='br-int',has_traffic_filtering=True,id=6b98003c-89e7-4f8a-a57c-426f0dab822a,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b98003c-89') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG os_vif [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:a5,bridge_name='br-int',has_traffic_filtering=True,id=6b98003c-89e7-4f8a-a57c-426f0dab822a,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b98003c-89') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b98003c-89, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b98003c-89, col_values=(('external_ids', {'iface-id': '6b98003c-89e7-4f8a-a57c-426f0dab822a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:43:a5', 'vm-uuid': '4c8d3ab9-801b-41ba-ad20-2e202eccf0e7'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:23 user nova-compute[73144]: INFO os_vif [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:a5,bridge_name='br-int',has_traffic_filtering=True,id=6b98003c-89e7-4f8a-a57c-426f0dab822a,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b98003c-89')
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:54:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No VIF found with MAC fa:16:3e:13:43:a5, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updated VIF entry in instance network info cache for port 6b98003c-89e7-4f8a-a57c-426f0dab822a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updating instance_info_cache with network_info: [{"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9ec10ebc-7166-4895-9589-7fd7c2aa7c69 req-ee5ce20b-d66c-49b4-b0e2-16fdb30c117a service nova] Releasing lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23161643162373431', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643162373431', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:54:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912081673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912081673',id=26,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-zieqpqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:54:07Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=5229a303-2dad-45a6-b140-29a55d8d29a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'pci_devices' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:54:24 user nova-compute[73144]:   <uuid>5229a303-2dad-45a6-b140-29a55d8d29a7</uuid>
Aug 14 21:54:24 user nova-compute[73144]:   <name>instance-0000001a</name>
Aug 14 21:54:24 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:54:24 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:54:24 user nova-compute[73144]:   <metadata>
Aug 14 21:54:24 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:54:24 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:54:24 user nova-compute[73144]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1912081673</nova:name>
Aug 14 21:54:24 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:54:22</nova:creationTime>
Aug 14 21:54:24 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:54:24 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:54:24 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:54:24 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:54:24 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:54:24 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:54:24 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:54:24 user nova-compute[73144]:       <nova:owner>
Aug 14 21:54:24 user nova-compute[73144]:         <nova:user uuid="cfe8b1fc0405438c99d3edd956e103a4">tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member</nova:user>
Aug 14 21:54:24 user nova-compute[73144]:         <nova:project uuid="59e45dfdc13e486e950f6bc8595bb8fa">tempest-ServerBootFromVolumeStableRescueTest-847208830</nova:project>
Aug 14 21:54:24 user nova-compute[73144]:       </nova:owner>
Aug 14 21:54:24 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:54:24 user nova-compute[73144]:       <nova:ports>
Aug 14 21:54:24 user nova-compute[73144]:         <nova:port uuid="b3326f41-f503-40b1-a924-be55d27143a1">
Aug 14 21:54:24 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:54:24 user nova-compute[73144]:         </nova:port>
Aug 14 21:54:24 user nova-compute[73144]:       </nova:ports>
Aug 14 21:54:24 user nova-compute[73144]:     </nova:instance>
Aug 14 21:54:24 user nova-compute[73144]:   </metadata>
Aug 14 21:54:24 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:54:24 user nova-compute[73144]:     <system>
Aug 14 21:54:24 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:54:24 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:54:24 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:54:24 user nova-compute[73144]:       <entry name="serial">5229a303-2dad-45a6-b140-29a55d8d29a7</entry>
Aug 14 21:54:24 user nova-compute[73144]:       <entry name="uuid">5229a303-2dad-45a6-b140-29a55d8d29a7</entry>
Aug 14 21:54:24 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:54:24 user nova-compute[73144]:     </system>
Aug 14 21:54:24 user nova-compute[73144]:   </sysinfo>
Aug 14 21:54:24 user nova-compute[73144]:   <os>
Aug 14 21:54:24 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:54:24 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:54:24 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:54:24 user nova-compute[73144]:   </os>
Aug 14 21:54:24 user nova-compute[73144]:   <features>
Aug 14 21:54:24 user nova-compute[73144]:     <acpi/>
Aug 14 21:54:24 user nova-compute[73144]:     <apic/>
Aug 14 21:54:24 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:54:24 user nova-compute[73144]:   </features>
Aug 14 21:54:24 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:54:24 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:54:24 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:54:24 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:54:24 user nova-compute[73144]:   </clock>
Aug 14 21:54:24 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:54:24 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:54:24 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:54:24 user nova-compute[73144]:   </cpu>
Aug 14 21:54:24 user nova-compute[73144]:   <devices>
Aug 14 21:54:24 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:54:24 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:54:24 user nova-compute[73144]:       <source dev="/dev/sdc"/>
Aug 14 21:54:24 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:54:24 user nova-compute[73144]:       <serial>87b56623-f20c-428c-9ea2-ac2f0eeba823</serial>
Aug 14 21:54:24 user nova-compute[73144]:     </disk>
Aug 14 21:54:24 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:54:24 user nova-compute[73144]:       <mac address="fa:16:3e:15:de:d2"/>
Aug 14 21:54:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:54:24 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:54:24 user nova-compute[73144]:       <target dev="tapb3326f41-f5"/>
Aug 14 21:54:24 user nova-compute[73144]:     </interface>
Aug 14 21:54:24 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:54:24 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/console.log" append="off"/>
Aug 14 21:54:24 user nova-compute[73144]:     </serial>
Aug 14 21:54:24 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:54:24 user nova-compute[73144]:     <video>
Aug 14 21:54:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:54:24 user nova-compute[73144]:     </video>
Aug 14 21:54:24 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:54:24 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:54:24 user nova-compute[73144]:     </rng>
Aug 14 21:54:24 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:54:24 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:54:24 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:54:24 user nova-compute[73144]:     </memballoon>
Aug 14 21:54:24 user nova-compute[73144]:   </devices>
Aug 14 21:54:24 user nova-compute[73144]: </domain>
Aug 14 21:54:24 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:54:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912081673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912081673',id=26,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-zieqpqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:54:07Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=5229a303-2dad-45a6-b140-29a55d8d29a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG os_vif [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3326f41-f5, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3326f41-f5, col_values=(('external_ids', {'iface-id': 'b3326f41-f503-40b1-a924-be55d27143a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:de:d2', 'vm-uuid': '5229a303-2dad-45a6-b140-29a55d8d29a7'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:24 user nova-compute[73144]: INFO os_vif [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5')
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:54:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No VIF found with MAC fa:16:3e:15:de:d2, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-f4c4fd93-dcb9-4baf-8ea5-b8eba5119cd6 req-5cf20705-349a-437f-9d17-b783fd08abb1 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f4c4fd93-dcb9-4baf-8ea5-b8eba5119cd6 req-5cf20705-349a-437f-9d17-b783fd08abb1 service nova] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f4c4fd93-dcb9-4baf-8ea5-b8eba5119cd6 req-5cf20705-349a-437f-9d17-b783fd08abb1 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f4c4fd93-dcb9-4baf-8ea5-b8eba5119cd6 req-5cf20705-349a-437f-9d17-b783fd08abb1 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-f4c4fd93-dcb9-4baf-8ea5-b8eba5119cd6 req-5cf20705-349a-437f-9d17-b783fd08abb1 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] No waiting events found dispatching network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:25 user nova-compute[73144]: WARNING nova.compute.manager [req-f4c4fd93-dcb9-4baf-8ea5-b8eba5119cd6 req-5cf20705-349a-437f-9d17-b783fd08abb1 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received unexpected event network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a for instance with vm_state building and task_state spawning.
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] No waiting events found dispatching network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:27 user nova-compute[73144]: WARNING nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received unexpected event network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a for instance with vm_state building and task_state spawning.
Aug 14 21:54:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:27 user nova-compute[73144]: WARNING nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state building and task_state spawning.
Aug 14 21:54:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:27 user nova-compute[73144]: WARNING nova.compute.manager [req-e534513a-46d6-4d83-892a-7478fb9df0af req-77723d63-f2ed-4a99-9083-56355b9d5b87 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state building and task_state spawning.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050068.588, 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] VM Resumed (Lifecycle Event)
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Instance spawned successfully.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050068.590859, 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] VM Started (Lifecycle Event)
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050068.723706, 5229a303-2dad-45a6-b140-29a55d8d29a7 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] VM Resumed (Lifecycle Event)
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance spawned successfully.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050068.7258976, 5229a303-2dad-45a6-b140-29a55d8d29a7 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] VM Started (Lifecycle Event)
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:54:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Took 7.86 seconds to build instance.
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4358a357-4b78-49f9-8acb-43b7bc8a5f8d tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.957s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:28 user nova-compute[73144]: INFO nova.compute.manager [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Took 23.06 seconds to build instance.
Aug 14 21:54:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1b76796f-f7ed-4053-908b-5e828771846f tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.199s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:46 user nova-compute[73144]: INFO nova.compute.manager [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Terminating instance
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-1626b0cf-1fec-4384-a4b4-6c1e367774b7 req-be6032af-7c36-4b84-a1e4-6800c87bd8e2 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-unplugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1626b0cf-1fec-4384-a4b4-6c1e367774b7 req-be6032af-7c36-4b84-a1e4-6800c87bd8e2 service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1626b0cf-1fec-4384-a4b4-6c1e367774b7 req-be6032af-7c36-4b84-a1e4-6800c87bd8e2 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1626b0cf-1fec-4384-a4b4-6c1e367774b7 req-be6032af-7c36-4b84-a1e4-6800c87bd8e2 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-1626b0cf-1fec-4384-a4b4-6c1e367774b7 req-be6032af-7c36-4b84-a1e4-6800c87bd8e2 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-unplugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-1626b0cf-1fec-4384-a4b4-6c1e367774b7 req-be6032af-7c36-4b84-a1e4-6800c87bd8e2 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-unplugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Instance destroyed successfully.
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'resources' on Instance uuid ea802951-a15c-4dac-a693-4fe96ef3cc9f {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1593031860',display_name='tempest-ServerActionsTestOtherA-server-1475160519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1593031860',id=15,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqCumZ/fmgKOc7IfkPXpmLzqkGmsWcfXH/aHSLL63EIDPCYrbA7aV6dRIW5fpx+mmgIckHG/r4NRGJy6RPYUzNm64l35X06MrWUIA4QzuIwUkrvl1av/AdaNxdmexJsw==',key_name='tempest-keypair-1493275970',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-ffz2q41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=ea802951-a15c-4dac-a693-4fe96ef3cc9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "address": "fa:16:3e:4a:bd:e4", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7e06eb-2d", "ovs_interfaceid": "6f7e06eb-2d48-431d-9305-24dc4801c99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG os_vif [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f7e06eb-2d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:46 user nova-compute[73144]: INFO os_vif [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bd:e4,bridge_name='br-int',has_traffic_filtering=True,id=6f7e06eb-2d48-431d-9305-24dc4801c99a,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7e06eb-2d')
Aug 14 21:54:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Deleting instance files /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f_del
Aug 14 21:54:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Deletion of /opt/stack/data/nova/instances/ea802951-a15c-4dac-a693-4fe96ef3cc9f_del complete
Aug 14 21:54:46 user nova-compute[73144]: INFO nova.compute.manager [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 21:54:46 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:54:46 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:54:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:47 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:47 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Took 0.82 seconds to deallocate network for instance.
Aug 14 21:54:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-ab94ac19-002c-460e-a5d0-61930655cbd5 req-bbae7d74-4152-4fe0-9bc4-a15b694e38ca service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-deleted-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:48 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Deleted allocations for instance ea802951-a15c-4dac-a693-4fe96ef3cc9f
Aug 14 21:54:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8f72705-91ac-423e-819b-24c0cf6fdb42 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-831fa7e0-af79-4296-ba22-20f4e3db7150 req-fecfa2bb-5658-428c-b9f3-e62facdc5578 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-831fa7e0-af79-4296-ba22-20f4e3db7150 req-fecfa2bb-5658-428c-b9f3-e62facdc5578 service nova] Acquiring lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-831fa7e0-af79-4296-ba22-20f4e3db7150 req-fecfa2bb-5658-428c-b9f3-e62facdc5578 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-831fa7e0-af79-4296-ba22-20f4e3db7150 req-fecfa2bb-5658-428c-b9f3-e62facdc5578 service nova] Lock "ea802951-a15c-4dac-a693-4fe96ef3cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-831fa7e0-af79-4296-ba22-20f4e3db7150 req-fecfa2bb-5658-428c-b9f3-e62facdc5578 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] No waiting events found dispatching network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:48 user nova-compute[73144]: WARNING nova.compute.manager [req-831fa7e0-af79-4296-ba22-20f4e3db7150 req-fecfa2bb-5658-428c-b9f3-e62facdc5578 service nova] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Received unexpected event network-vif-plugged-6f7e06eb-2d48-431d-9305-24dc4801c99a for instance with vm_state deleted and task_state None.
Aug 14 21:54:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:54 user nova-compute[73144]: INFO nova.compute.manager [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Terminating instance
Aug 14 21:54:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-730da112-b4ee-492e-9959-e46c8e71a6b3 req-9ce31357-0a96-449d-a2cf-a78dd87ce285 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-vif-unplugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-730da112-b4ee-492e-9959-e46c8e71a6b3 req-9ce31357-0a96-449d-a2cf-a78dd87ce285 service nova] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-730da112-b4ee-492e-9959-e46c8e71a6b3 req-9ce31357-0a96-449d-a2cf-a78dd87ce285 service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-730da112-b4ee-492e-9959-e46c8e71a6b3 req-9ce31357-0a96-449d-a2cf-a78dd87ce285 service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-730da112-b4ee-492e-9959-e46c8e71a6b3 req-9ce31357-0a96-449d-a2cf-a78dd87ce285 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] No waiting events found dispatching network-vif-unplugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-730da112-b4ee-492e-9959-e46c8e71a6b3 req-9ce31357-0a96-449d-a2cf-a78dd87ce285 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-vif-unplugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:54:55 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Instance destroyed successfully.
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.objects.instance [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'resources' on Instance uuid 97776072-7d34-4549-8f2e-bc01db5cba92 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-406134668',display_name='tempest-AttachVolumeNegativeTest-server-406134668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-406134668',id=22,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrgLs7eC0Twgf8ZwTwVL4HjpYKVaSX62FXlcahC4i3TaFZhU5pEI5tnMziJJ+FeUR5HhKVIkKYqoZsbEYvvLMTu0nK/4ICW2MkwZ/qHSZd3CkfztsBfDXdrYWffcON2Ig==',key_name='tempest-keypair-1210752663',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:51:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-ff4y0ecw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=97776072-7d34-4549-8f2e-bc01db5cba92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "address": "fa:16:3e:3a:75:2c", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa01c90a6-af", "ovs_interfaceid": "a01c90a6-af4f-47c5-98ac-b2bb00fa2006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:75:2c,bridge_name='br-int',has_traffic_filtering=True,id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa01c90a6-af') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG os_vif [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:75:2c,bridge_name='br-int',has_traffic_filtering=True,id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa01c90a6-af') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa01c90a6-af, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:54:55 user nova-compute[73144]: INFO os_vif [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:75:2c,bridge_name='br-int',has_traffic_filtering=True,id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa01c90a6-af')
Aug 14 21:54:55 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Deleting instance files /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92_del
Aug 14 21:54:55 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Deletion of /opt/stack/data/nova/instances/97776072-7d34-4549-8f2e-bc01db5cba92_del complete
Aug 14 21:54:55 user nova-compute[73144]: INFO nova.compute.manager [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 21:54:55 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:54:55 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:54:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:56 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-0ff60f04-5aaa-4f61-8ed9-f2d004c26c93 req-6264ca4f-27a4-41d8-b6f9-1680ee043575 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-vif-deleted-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:57 user nova-compute[73144]: INFO nova.compute.manager [req-0ff60f04-5aaa-4f61-8ed9-f2d004c26c93 req-6264ca4f-27a4-41d8-b6f9-1680ee043575 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Neutron deleted interface a01c90a6-af4f-47c5-98ac-b2bb00fa2006; detaching it from the instance and deleting it from the info cache
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.network.neutron [req-0ff60f04-5aaa-4f61-8ed9-f2d004c26c93 req-6264ca4f-27a4-41d8-b6f9-1680ee043575 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:57 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Took 1.25 seconds to deallocate network for instance.
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-0ff60f04-5aaa-4f61-8ed9-f2d004c26c93 req-6264ca4f-27a4-41d8-b6f9-1680ee043575 service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Detach interface failed, port_id=a01c90a6-af4f-47c5-98ac-b2bb00fa2006, reason: Instance 97776072-7d34-4549-8f2e-bc01db5cba92 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:57 user nova-compute[73144]: INFO nova.compute.manager [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Terminating instance
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-baeea72a-9d2b-4f80-bd4a-4dfc2eb116af req-84f9a537-0ebd-4a3c-bbad-ea603838e90c service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received event network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-baeea72a-9d2b-4f80-bd4a-4dfc2eb116af req-84f9a537-0ebd-4a3c-bbad-ea603838e90c service nova] Acquiring lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-baeea72a-9d2b-4f80-bd4a-4dfc2eb116af req-84f9a537-0ebd-4a3c-bbad-ea603838e90c service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-baeea72a-9d2b-4f80-bd4a-4dfc2eb116af req-84f9a537-0ebd-4a3c-bbad-ea603838e90c service nova] Lock "97776072-7d34-4549-8f2e-bc01db5cba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-baeea72a-9d2b-4f80-bd4a-4dfc2eb116af req-84f9a537-0ebd-4a3c-bbad-ea603838e90c service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] No waiting events found dispatching network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:57 user nova-compute[73144]: WARNING nova.compute.manager [req-baeea72a-9d2b-4f80-bd4a-4dfc2eb116af req-84f9a537-0ebd-4a3c-bbad-ea603838e90c service nova] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Received unexpected event network-vif-plugged-a01c90a6-af4f-47c5-98ac-b2bb00fa2006 for instance with vm_state deleted and task_state None.
Aug 14 21:54:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:57 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Deleted allocations for instance 97776072-7d34-4549-8f2e-bc01db5cba92
Aug 14 21:54:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6cbe48db-a8a3-465c-b7ec-d187bcfaf283 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "97776072-7d34-4549-8f2e-bc01db5cba92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.869s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Instance destroyed successfully.
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.objects.instance [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'resources' on Instance uuid 5fb72bd6-7deb-4a48-b1ef-410911faec15 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1723144730',display_name='tempest-AttachVolumeTestJSON-server-1723144730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1723144730',id=4,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNU63kUtMO7Fmkha4oysk1SF78Ghyu6Tdkg/Nm2WABkMmArRd2lGcF+Ls8zpdrt31ev+uubMugjGBVUCna/CowUuRfJdQBAatk06oeLBncaOwo/8MoJ0REsEMxbzru1Eg==',key_name='tempest-keypair-1838938455',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-vs84y7er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=5fb72bd6-7deb-4a48-b1ef-410911faec15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "address": "fa:16:3e:fb:d3:d3", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405993c1-92", "ovs_interfaceid": "405993c1-92ac-4e9f-b75c-44deb4a9f3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG os_vif [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap405993c1-92, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:54:58 user nova-compute[73144]: INFO os_vif [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=405993c1-92ac-4e9f-b75c-44deb4a9f3dd,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405993c1-92')
Aug 14 21:54:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Deleting instance files /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15_del
Aug 14 21:54:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Deletion of /opt/stack/data/nova/instances/5fb72bd6-7deb-4a48-b1ef-410911faec15_del complete
Aug 14 21:54:58 user nova-compute[73144]: INFO nova.compute.manager [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 21:54:58 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:54:58 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:54:58 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Took 0.85 seconds to deallocate network for instance.
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:59 user nova-compute[73144]: WARNING nova.compute.manager [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-unplugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state deleted and task_state None.
Aug 14 21:54:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] Acquiring lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] No waiting events found dispatching network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:54:59 user nova-compute[73144]: WARNING nova.compute.manager [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received unexpected event network-vif-plugged-405993c1-92ac-4e9f-b75c-44deb4a9f3dd for instance with vm_state deleted and task_state None.
Aug 14 21:54:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-88125562-6f1f-4108-8ecc-b0703034f2b0 req-41ec64b6-74cd-4dd0-a73e-b2c6669895ba service nova] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Received event network-vif-deleted-405993c1-92ac-4e9f-b75c-44deb4a9f3dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:54:59 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Deleted allocations for instance 5fb72bd6-7deb-4a48-b1ef-410911faec15
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:54:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57eeb962-ca37-4f27-a771-5bc54a96586c tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "5fb72bd6-7deb-4a48-b1ef-410911faec15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.357s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:01 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050086.8491786, ea802951-a15c-4dac-a693-4fe96ef3cc9f => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:01 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] VM Stopped (Lifecycle Event)
Aug 14 21:55:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0b63cc25-f8df-4a7f-b547-9c3d988d40b7 None None] [instance: ea802951-a15c-4dac-a693-4fe96ef3cc9f] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:55:08 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:08 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7259MB free_disk=25.427059173583984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 67dcd12b-616a-4f37-ad82-af85e2226b9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance db61b783-50d7-4304-a031-f9fb11069ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 89f447d4-22b3-42f7-8830-9facdce3412c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:55:08 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:55:09 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:55:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050095.58014, 97776072-7d34-4549-8f2e-bc01db5cba92 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:10 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] VM Stopped (Lifecycle Event)
Aug 14 21:55:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6287c689-b9c1-4bcf-b820-903f0a17b691 None None] [instance: 97776072-7d34-4549-8f2e-bc01db5cba92] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updating instance_info_cache with network_info: [{"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:13 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050098.0092757, 5fb72bd6-7deb-4a48-b1ef-410911faec15 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:13 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] VM Stopped (Lifecycle Event)
Aug 14 21:55:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b93958bb-d916-440f-90e2-b9b097674e74 None None] [instance: 5fb72bd6-7deb-4a48-b1ef-410911faec15] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:55:18 user nova-compute[73144]: INFO nova.compute.claims [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Claim successful on node user
Aug 14 21:55:18 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:55:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:55:19 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:55:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:55:19 user nova-compute[73144]: INFO nova.virt.block_device [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Booting with volume e06162af-f987-4cb8-aee8-7588733ce230 at /dev/vda
Aug 14 21:55:19 user nova-compute[73144]: DEBUG nova.policy [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbb0f6e9d9c44114b6264802443c6e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120d1e9570db4175920fa929cceb5dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG os_brick.utils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b134be4b-dbcc-4877-b82e-e6fbcecd6610]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2296ba6b-6934-4700-8fb3-4bf76d61f7a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ae09be-7425-4b00-acbb-184a01d13fd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb47a7a-9a02-4a4f-9dab-ee882a1d2f84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:55:19 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:55:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c1bd4b-8419-4864-bfac-e8b91245d527]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG os_brick.utils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updating existing volume attachment record: e4929291-fc9f-440d-8e5d-fbc9842b5068 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:55:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Successfully created port: 53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Successfully updated port: 53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquired lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-changed-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Refreshing instance network info cache due to event network-changed-53ee31ef-9655-4010-97f0-cbba5f46dd25. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] Acquiring lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updating instance_info_cache with network_info: [{"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Releasing lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance network_info: |[{"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] Acquired lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Refreshing network info cache for port 53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updated VIF entry in instance network info cache for port 53ee31ef-9655-4010-97f0-cbba5f46dd25. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updating instance_info_cache with network_info: [{"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b3100b7-0e5b-4826-8e24-eef12c9ccc7c req-9482a82c-6d5d-48f6-a520-1b5209746fa0 service nova] Releasing lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:28 user nova-compute[73144]: INFO nova.compute.manager [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Rescuing
Aug 14 21:55:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:55:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:55:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Creating image(s)
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Ensure instance console log exists: /opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Start _get_guest_xml network_info=[{"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'e4929291-fc9f-440d-8e5d-fbc9842b5068', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5d5bf63-c36b-49d4-9b1a-3b0400da8316', 'attached_at': '', 'detached_at': '', 'volume_id': 'e06162af-f987-4cb8-aee8-7588733ce230', 'serial': 'e06162af-f987-4cb8-aee8-7588733ce230'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:55:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:55:29 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:55:29 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:55:29 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b417d-02c1-474f-90bb-dc95fd9ecbca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:55:29 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b0207-3fe7-42ea-ba2c-5c779120dadf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230] added
Aug 14 21:55:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[590e00b6-7c20-44b1-b579-38f91834c37c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-2fb96f23-c6c4-44d9-94e9-5b9e604e8384 req-0bc6197a-b431-44ad-aa92-59adebe28e0d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2fb96f23-c6c4-44d9-94e9-5b9e604e8384 req-0bc6197a-b431-44ad-aa92-59adebe28e0d service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2fb96f23-c6c4-44d9-94e9-5b9e604e8384 req-0bc6197a-b431-44ad-aa92-59adebe28e0d service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2fb96f23-c6c4-44d9-94e9-5b9e604e8384 req-0bc6197a-b431-44ad-aa92-59adebe28e0d service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-2fb96f23-c6c4-44d9-94e9-5b9e604e8384 req-0bc6197a-b431-44ad-aa92-59adebe28e0d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:29 user nova-compute[73144]: WARNING nova.compute.manager [req-2fb96f23-c6c4-44d9-94e9-5b9e604e8384 req-0bc6197a-b431-44ad-aa92-59adebe28e0d service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state active and task_state rescuing.
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f0f1f-f5fb-4a21-bb04-15b8232ee5c5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuRWPyYr {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuRWPyYr" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feadf61-0f9e-45d8-a939-c35988c3c08f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuRWPyYr'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance destroyed successfully.
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Attempting rescue
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73144) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 21:55:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Creating image(s)
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66b3bb2-c9bc-4136-aedb-3c33967de010]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9709989-4d77-426a-af2e-45c9f1560327]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb783fbe-8382-492c-b4fb-29d984e32ac5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]
Aug 14 21:55:29 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.
Aug 14 21:55:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[343db25e-fda9-4d0e-9b37-8cc8ca79426a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b4f464-fa90-42d3-b66b-6a0b216e7510]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb63f293-f4a0-43f7-8df2-594cc124b347]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue" returned: 0 in 0.056s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'migration_context' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Start _get_guest_xml network_info=[{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:ff:51:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '53539290-1600-4e84-8f24-496f41396a43', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'resources' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'numa_topology' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-733506174',display_name='tempest-ServerRescueNegativeTestJSON-server-733506174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-733506174',id=20,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ljinwyz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:50:52Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=9a143491-b86c-4768-9014-306bbeee8ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:ff:51:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:ff:51:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:55:29 user nova-compute[73144]:   <uuid>9a143491-b86c-4768-9014-306bbeee8ad9</uuid>
Aug 14 21:55:29 user nova-compute[73144]:   <name>instance-00000014</name>
Aug 14 21:55:29 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:55:29 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:55:29 user nova-compute[73144]:   <metadata>
Aug 14 21:55:29 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:55:29 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:55:29 user nova-compute[73144]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-733506174</nova:name>
Aug 14 21:55:29 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:55:29</nova:creationTime>
Aug 14 21:55:29 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:55:29 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:55:29 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:55:29 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:55:29 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:55:29 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:55:29 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:55:29 user nova-compute[73144]:       <nova:owner>
Aug 14 21:55:29 user nova-compute[73144]:         <nova:user uuid="8d90a89f0b384bfbbabfc57e098efc45">tempest-ServerRescueNegativeTestJSON-89538024-project-member</nova:user>
Aug 14 21:55:29 user nova-compute[73144]:         <nova:project uuid="8cc2faa54982470a8ff513ec75cf0546">tempest-ServerRescueNegativeTestJSON-89538024</nova:project>
Aug 14 21:55:29 user nova-compute[73144]:       </nova:owner>
Aug 14 21:55:29 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:55:29 user nova-compute[73144]:       <nova:ports>
Aug 14 21:55:29 user nova-compute[73144]:         <nova:port uuid="fc78b43d-4f53-4973-bd15-95772d01fdf7">
Aug 14 21:55:29 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:55:29 user nova-compute[73144]:         </nova:port>
Aug 14 21:55:29 user nova-compute[73144]:       </nova:ports>
Aug 14 21:55:29 user nova-compute[73144]:     </nova:instance>
Aug 14 21:55:29 user nova-compute[73144]:   </metadata>
Aug 14 21:55:29 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:55:29 user nova-compute[73144]:     <system>
Aug 14 21:55:29 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:55:29 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:55:29 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:55:29 user nova-compute[73144]:       <entry name="serial">9a143491-b86c-4768-9014-306bbeee8ad9</entry>
Aug 14 21:55:29 user nova-compute[73144]:       <entry name="uuid">9a143491-b86c-4768-9014-306bbeee8ad9</entry>
Aug 14 21:55:29 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:55:29 user nova-compute[73144]:     </system>
Aug 14 21:55:29 user nova-compute[73144]:   </sysinfo>
Aug 14 21:55:29 user nova-compute[73144]:   <os>
Aug 14 21:55:29 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:55:29 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:55:29 user nova-compute[73144]:   </os>
Aug 14 21:55:29 user nova-compute[73144]:   <features>
Aug 14 21:55:29 user nova-compute[73144]:     <acpi/>
Aug 14 21:55:29 user nova-compute[73144]:     <apic/>
Aug 14 21:55:29 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:55:29 user nova-compute[73144]:   </features>
Aug 14 21:55:29 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:55:29 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:55:29 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:55:29 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:55:29 user nova-compute[73144]:   </clock>
Aug 14 21:55:29 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:55:29 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:55:29 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:55:29 user nova-compute[73144]:   </cpu>
Aug 14 21:55:29 user nova-compute[73144]:   <devices>
Aug 14 21:55:29 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:55:29 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:55:29 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue"/>
Aug 14 21:55:29 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:55:29 user nova-compute[73144]:     </disk>
Aug 14 21:55:29 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:55:29 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:55:29 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk"/>
Aug 14 21:55:29 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:55:29 user nova-compute[73144]:     </disk>
Aug 14 21:55:29 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:55:29 user nova-compute[73144]:       <mac address="fa:16:3e:ff:51:af"/>
Aug 14 21:55:29 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:29 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:55:29 user nova-compute[73144]:       <target dev="tapfc78b43d-4f"/>
Aug 14 21:55:29 user nova-compute[73144]:     </interface>
Aug 14 21:55:29 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:55:29 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/console.log" append="off"/>
Aug 14 21:55:29 user nova-compute[73144]:     </serial>
Aug 14 21:55:29 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:55:29 user nova-compute[73144]:     <video>
Aug 14 21:55:29 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:29 user nova-compute[73144]:     </video>
Aug 14 21:55:29 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:55:29 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:55:29 user nova-compute[73144]:     </rng>
Aug 14 21:55:29 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:55:29 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:55:29 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:55:29 user nova-compute[73144]:     </memballoon>
Aug 14 21:55:29 user nova-compute[73144]:   </devices>
Aug 14 21:55:29 user nova-compute[73144]: </domain>
Aug 14 21:55:29 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:55:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance destroyed successfully.
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:55:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No VIF found with MAC fa:16:3e:ff:51:af, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23265383365663363', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265383365663363', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-261204191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-261204191',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHZ/e53IiXo6wTwFCWP7MyIA/+2p/UAF9onpbLfhRdUpeTv4HK3RFYiXgJwZ6y8AcG53B74dTrxD9Wz7m4me6N5B1p7lg9g9vcR7+533T45GrcOu2F3MXDk2DK2Iu7Nw==',key_name='tempest-keypair-1594252963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120d1e9570db4175920fa929cceb5dca',ramdisk_id='',reservation_id='r-ll5f8vwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1866803179',owner_user_name='tempest-ServerActionsV293TestJSON-1866803179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:55:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb0f6e9d9c44114b6264802443c6e92',uuid=b5d5bf63-c36b-49d4-9b1a-3b0400da8316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converting VIF {"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.objects.instance [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'pci_devices' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:55:30 user nova-compute[73144]:   <uuid>b5d5bf63-c36b-49d4-9b1a-3b0400da8316</uuid>
Aug 14 21:55:30 user nova-compute[73144]:   <name>instance-0000001c</name>
Aug 14 21:55:30 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:55:30 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:55:30 user nova-compute[73144]:   <metadata>
Aug 14 21:55:30 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:55:30 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:55:30 user nova-compute[73144]:       <nova:name>tempest-ServerActionsV293TestJSON-server-261204191</nova:name>
Aug 14 21:55:30 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:55:29</nova:creationTime>
Aug 14 21:55:30 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:55:30 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:55:30 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:55:30 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:55:30 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:55:30 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:55:30 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:55:30 user nova-compute[73144]:       <nova:owner>
Aug 14 21:55:30 user nova-compute[73144]:         <nova:user uuid="fbb0f6e9d9c44114b6264802443c6e92">tempest-ServerActionsV293TestJSON-1866803179-project-member</nova:user>
Aug 14 21:55:30 user nova-compute[73144]:         <nova:project uuid="120d1e9570db4175920fa929cceb5dca">tempest-ServerActionsV293TestJSON-1866803179</nova:project>
Aug 14 21:55:30 user nova-compute[73144]:       </nova:owner>
Aug 14 21:55:30 user nova-compute[73144]:       <nova:ports>
Aug 14 21:55:30 user nova-compute[73144]:         <nova:port uuid="53ee31ef-9655-4010-97f0-cbba5f46dd25">
Aug 14 21:55:30 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 21:55:30 user nova-compute[73144]:         </nova:port>
Aug 14 21:55:30 user nova-compute[73144]:       </nova:ports>
Aug 14 21:55:30 user nova-compute[73144]:     </nova:instance>
Aug 14 21:55:30 user nova-compute[73144]:   </metadata>
Aug 14 21:55:30 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:55:30 user nova-compute[73144]:     <system>
Aug 14 21:55:30 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:55:30 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:55:30 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:55:30 user nova-compute[73144]:       <entry name="serial">b5d5bf63-c36b-49d4-9b1a-3b0400da8316</entry>
Aug 14 21:55:30 user nova-compute[73144]:       <entry name="uuid">b5d5bf63-c36b-49d4-9b1a-3b0400da8316</entry>
Aug 14 21:55:30 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:55:30 user nova-compute[73144]:     </system>
Aug 14 21:55:30 user nova-compute[73144]:   </sysinfo>
Aug 14 21:55:30 user nova-compute[73144]:   <os>
Aug 14 21:55:30 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:55:30 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:55:30 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:55:30 user nova-compute[73144]:   </os>
Aug 14 21:55:30 user nova-compute[73144]:   <features>
Aug 14 21:55:30 user nova-compute[73144]:     <acpi/>
Aug 14 21:55:30 user nova-compute[73144]:     <apic/>
Aug 14 21:55:30 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:55:30 user nova-compute[73144]:   </features>
Aug 14 21:55:30 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:55:30 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:55:30 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:55:30 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:55:30 user nova-compute[73144]:   </clock>
Aug 14 21:55:30 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:55:30 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:55:30 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:55:30 user nova-compute[73144]:   </cpu>
Aug 14 21:55:30 user nova-compute[73144]:   <devices>
Aug 14 21:55:30 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:55:30 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:55:30 user nova-compute[73144]:       <source dev="/dev/sdd"/>
Aug 14 21:55:30 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:55:30 user nova-compute[73144]:       <serial>e06162af-f987-4cb8-aee8-7588733ce230</serial>
Aug 14 21:55:30 user nova-compute[73144]:     </disk>
Aug 14 21:55:30 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:55:30 user nova-compute[73144]:       <mac address="fa:16:3e:6d:27:42"/>
Aug 14 21:55:30 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:30 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:55:30 user nova-compute[73144]:       <target dev="tap53ee31ef-96"/>
Aug 14 21:55:30 user nova-compute[73144]:     </interface>
Aug 14 21:55:30 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:55:30 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316/console.log" append="off"/>
Aug 14 21:55:30 user nova-compute[73144]:     </serial>
Aug 14 21:55:30 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:55:30 user nova-compute[73144]:     <video>
Aug 14 21:55:30 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:30 user nova-compute[73144]:     </video>
Aug 14 21:55:30 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:55:30 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:55:30 user nova-compute[73144]:     </rng>
Aug 14 21:55:30 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:55:30 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:55:30 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:55:30 user nova-compute[73144]:     </memballoon>
Aug 14 21:55:30 user nova-compute[73144]:   </devices>
Aug 14 21:55:30 user nova-compute[73144]: </domain>
Aug 14 21:55:30 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-261204191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-261204191',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHZ/e53IiXo6wTwFCWP7MyIA/+2p/UAF9onpbLfhRdUpeTv4HK3RFYiXgJwZ6y8AcG53B74dTrxD9Wz7m4me6N5B1p7lg9g9vcR7+533T45GrcOu2F3MXDk2DK2Iu7Nw==',key_name='tempest-keypair-1594252963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120d1e9570db4175920fa929cceb5dca',ramdisk_id='',reservation_id='r-ll5f8vwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1866803179',owner_user_name='tempest-ServerActionsV293TestJSON-1866803179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:55:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb0f6e9d9c44114b6264802443c6e92',uuid=b5d5bf63-c36b-49d4-9b1a-3b0400da8316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converting VIF {"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG os_vif [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ee31ef-96, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53ee31ef-96, col_values=(('external_ids', {'iface-id': '53ee31ef-9655-4010-97f0-cbba5f46dd25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:27:42', 'vm-uuid': 'b5d5bf63-c36b-49d4-9b1a-3b0400da8316'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:30 user nova-compute[73144]: INFO os_vif [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96')
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:55:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] No VIF found with MAC fa:16:3e:6d:27:42, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-969192f7-2d0e-4a79-bbeb-aab91255f7fe req-cdeee739-2be4-4653-9acb-5e00ecc50716 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-969192f7-2d0e-4a79-bbeb-aab91255f7fe req-cdeee739-2be4-4653-9acb-5e00ecc50716 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-969192f7-2d0e-4a79-bbeb-aab91255f7fe req-cdeee739-2be4-4653-9acb-5e00ecc50716 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-969192f7-2d0e-4a79-bbeb-aab91255f7fe req-cdeee739-2be4-4653-9acb-5e00ecc50716 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-969192f7-2d0e-4a79-bbeb-aab91255f7fe req-cdeee739-2be4-4653-9acb-5e00ecc50716 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:31 user nova-compute[73144]: WARNING nova.compute.manager [req-969192f7-2d0e-4a79-bbeb-aab91255f7fe req-cdeee739-2be4-4653-9acb-5e00ecc50716 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state active and task_state rescuing.
Aug 14 21:55:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-ab1dd03c-e664-46d8-b285-31f55ce951bb req-a9e3e80b-9a29-4e1b-9531-8f31a29bb55d service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ab1dd03c-e664-46d8-b285-31f55ce951bb req-a9e3e80b-9a29-4e1b-9531-8f31a29bb55d service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ab1dd03c-e664-46d8-b285-31f55ce951bb req-a9e3e80b-9a29-4e1b-9531-8f31a29bb55d service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ab1dd03c-e664-46d8-b285-31f55ce951bb req-a9e3e80b-9a29-4e1b-9531-8f31a29bb55d service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-ab1dd03c-e664-46d8-b285-31f55ce951bb req-a9e3e80b-9a29-4e1b-9531-8f31a29bb55d service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:32 user nova-compute[73144]: WARNING nova.compute.manager [req-ab1dd03c-e664-46d8-b285-31f55ce951bb req-a9e3e80b-9a29-4e1b-9531-8f31a29bb55d service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received unexpected event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with vm_state building and task_state spawning.
Aug 14 21:55:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:33 user nova-compute[73144]: WARNING nova.compute.manager [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state active and task_state rescuing.
Aug 14 21:55:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:33 user nova-compute[73144]: WARNING nova.compute.manager [req-eaf9aee0-bc91-420d-b1be-85c6547fc225 req-98c06abf-29ca-4492-ae49-ee378c5667b7 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state active and task_state rescuing.
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for 9a143491-b86c-4768-9014-306bbeee8ad9 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050134.853853, 9a143491-b86c-4768-9014-306bbeee8ad9 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] VM Resumed (Lifecycle Event)
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f27e9046-1113-4be5-8b08-09cbcf984ba8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:55:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050134.8549993, 9a143491-b86c-4768-9014-306bbeee8ad9 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] VM Started (Lifecycle Event)
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:55:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050135.0111265, b5d5bf63-c36b-49d4-9b1a-3b0400da8316 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] VM Resumed (Lifecycle Event)
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:55:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance spawned successfully.
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-30012b18-418e-459c-a2f4-e93269aab364 req-b745eb1b-e954-4749-882d-66b3ecef527c service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-30012b18-418e-459c-a2f4-e93269aab364 req-b745eb1b-e954-4749-882d-66b3ecef527c service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-30012b18-418e-459c-a2f4-e93269aab364 req-b745eb1b-e954-4749-882d-66b3ecef527c service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-30012b18-418e-459c-a2f4-e93269aab364 req-b745eb1b-e954-4749-882d-66b3ecef527c service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-30012b18-418e-459c-a2f4-e93269aab364 req-b745eb1b-e954-4749-882d-66b3ecef527c service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:35 user nova-compute[73144]: WARNING nova.compute.manager [req-30012b18-418e-459c-a2f4-e93269aab364 req-b745eb1b-e954-4749-882d-66b3ecef527c service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received unexpected event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with vm_state building and task_state spawning.
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050135.0142028, b5d5bf63-c36b-49d4-9b1a-3b0400da8316 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] VM Started (Lifecycle Event)
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:55:35 user nova-compute[73144]: INFO nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 14 21:55:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:55:35 user nova-compute[73144]: INFO nova.compute.manager [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Took 16.67 seconds to build instance.
Aug 14 21:55:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-95b4f0d3-a9a0-4b55-89e3-d7b7020fdb75 tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.807s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing instance network info cache due to event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] Acquiring lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] Acquired lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:37 user nova-compute[73144]: DEBUG nova.network.neutron [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updated VIF entry in instance network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-605f74fa-037e-40b9-8ac3-56a6c4bda177 req-2587cc63-66b3-4880-af23-7822999ea998 service nova] Releasing lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:42 user nova-compute[73144]: INFO nova.compute.manager [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Shelving
Aug 14 21:55:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-53445930-d1cf-408e-b337-dd3f4dabc2da req-21e02309-773a-430c-9688-8670211f6b34 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-unplugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-53445930-d1cf-408e-b337-dd3f4dabc2da req-21e02309-773a-430c-9688-8670211f6b34 service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-53445930-d1cf-408e-b337-dd3f4dabc2da req-21e02309-773a-430c-9688-8670211f6b34 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-53445930-d1cf-408e-b337-dd3f4dabc2da req-21e02309-773a-430c-9688-8670211f6b34 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-53445930-d1cf-408e-b337-dd3f4dabc2da req-21e02309-773a-430c-9688-8670211f6b34 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-unplugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:42 user nova-compute[73144]: WARNING nova.compute.manager [req-53445930-d1cf-408e-b337-dd3f4dabc2da req-21e02309-773a-430c-9688-8670211f6b34 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received unexpected event network-vif-unplugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with vm_state active and task_state shelving.
Aug 14 21:55:43 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance destroyed successfully.
Aug 14 21:55:43 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Beginning cold snapshot process
Aug 14 21:55:43 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:55:43 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk /opt/stack/data/nova/instances/snapshots/tmpe0mdyont/d2e0368c8b8e4a7c9a498d4817052c75 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk /opt/stack/data/nova/instances/snapshots/tmpe0mdyont/d2e0368c8b8e4a7c9a498d4817052c75" returned: 0 in 0.609s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:44 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Snapshot extracted, beginning image upload
Aug 14 21:55:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-6d312e81-e540-4086-8776-a5709b2d6c68 req-db0cc2d2-dab7-4591-a226-fea90f72c782 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6d312e81-e540-4086-8776-a5709b2d6c68 req-db0cc2d2-dab7-4591-a226-fea90f72c782 service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6d312e81-e540-4086-8776-a5709b2d6c68 req-db0cc2d2-dab7-4591-a226-fea90f72c782 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6d312e81-e540-4086-8776-a5709b2d6c68 req-db0cc2d2-dab7-4591-a226-fea90f72c782 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-6d312e81-e540-4086-8776-a5709b2d6c68 req-db0cc2d2-dab7-4591-a226-fea90f72c782 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:44 user nova-compute[73144]: WARNING nova.compute.manager [req-6d312e81-e540-4086-8776-a5709b2d6c68 req-db0cc2d2-dab7-4591-a226-fea90f72c782 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received unexpected event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 21:55:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Snapshot image upload complete
Aug 14 21:55:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:46 user nova-compute[73144]: INFO nova.compute.manager [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Shelve offloading
Aug 14 21:55:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance destroyed successfully.
Aug 14 21:55:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquired lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:55:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Releasing lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance destroyed successfully.
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'resources' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1737547142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1737547142',id=24,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH38bkufm/qGiYeooM925P2qMy5I531AMDQ4MiSpll0SMC2jTiN6Xml+/7KbitUtc/eB/HVnvu5PMqygkBkSM2zwNVpjUWVIPJ0s517qp32qOXrsZbOYDoSHGkjfB3PqQ==',key_name='tempest-keypair-1826093270',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-gir6zm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member',shelved_at='2023-08-14T21:55:46.333982',shelved_host='user',shelved_image_id='7db968ee-b1c3-4b7f-ad14-03c43bca0012'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=db61b783-50d7-4304-a031-f9fb11069ef1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG os_vif [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf39a4a57-be, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:47 user nova-compute[73144]: INFO os_vif [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be')
Aug 14 21:55:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Deleting instance files /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1_del
Aug 14 21:55:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Deletion of /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1_del complete
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing instance network info cache due to event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] Acquiring lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] Acquired lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.network.neutron [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:47 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Deleted allocations for instance db61b783-50d7-4304-a031-f9fb11069ef1
Aug 14 21:55:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'numa_topology' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:48 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:55:48 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:55:48 user nova-compute[73144]: DEBUG nova.network.neutron [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updated VIF entry in instance network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:48 user nova-compute[73144]: DEBUG nova.network.neutron [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf39a4a57-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a1d502e-1381-4c0b-accc-4dfe23c47013 req-95392c5c-3dea-4415-a85c-3431e36af6c9 service nova] Releasing lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-77dc87b6-71c1-467f-98c4-e17a50726b5f tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.836s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:55:49 user nova-compute[73144]: INFO nova.compute.claims [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Claim successful on node user
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-changed-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing instance network info cache due to event network-changed-ea4de1a3-ece8-4141-b210-addf8b81a5ee. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] Acquiring lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] Acquired lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Refreshing network info cache for port ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:55:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.policy [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '597588abcb1a4963a536b2b078ceef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b004e49247a041b7b00500416a625ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:55:50 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Creating image(s)
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "/opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "/opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk 1073741824" returned: 0 in 0.050s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Cannot resize image /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'migration_context' on Instance uuid 91a32f0f-91a7-4724-ace4-8a333dee6878 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Ensure instance console log exists: /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-changed-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Refreshing instance network info cache due to event network-changed-25845491-fe11-4220-8641-c32668bd0b0f. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] Acquiring lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] Acquired lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Refreshing network info cache for port 25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Successfully created port: b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.network.neutron [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updated VIF entry in instance network info cache for port ea4de1a3-ece8-4141-b210-addf8b81a5ee. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.network.neutron [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [{"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-92379551-c605-469d-b729-1e161f644bf9 req-ab3eedd6-472a-453a-b759-61f24c3535dd service nova] Releasing lock "refresh_cache-67dcd12b-616a-4f37-ad82-af85e2226b9c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.network.neutron [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updated VIF entry in instance network info cache for port 25845491-fe11-4220-8641-c32668bd0b0f. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.network.neutron [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating instance_info_cache with network_info: [{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10ddeb90-2af2-4472-9927-6f91cb0c4e27 req-312e75d0-a166-460b-861f-0356226ffe69 service nova] Releasing lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "interface-89f447d4-22b3-42f7-8830-9facdce3412c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "interface-89f447d4-22b3-42f7-8830-9facdce3412c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lazy-loading 'flavor' on Instance uuid 89f447d4-22b3-42f7-8830-9facdce3412c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lazy-loading 'pci_requests' on Instance uuid 89f447d4-22b3-42f7-8830-9facdce3412c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:51 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.policy [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb1f449772884d49a1d6355fd3c49908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3174ac5ed0da4e0faa1404a52ccc760f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Successfully updated port: b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquired lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-changed-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Refreshing instance network info cache due to event network-changed-b3e4c67b-c987-4848-830f-e644dd36f5a9. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] Acquiring lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Successfully created port: 270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updating instance_info_cache with network_info: [{"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Releasing lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Instance network_info: |[{"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] Acquired lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.neutron [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Refreshing network info cache for port b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Start _get_guest_xml network_info=[{"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:55:52 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:52 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-969756107',display_name='tempest-AttachVolumeNegativeTest-server-969756107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-969756107',id=29,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBm2HXcxJAFNoQyOa3+GmKXwT37GV7hJNJW3C2dM93JXra0M7VneAY/D9111CAdCxe20X17gnwZ3zLl+5rPM1dkYMVtB9X/Jjlgl9RRUQe3qhaRgxUZO5yjDxgBxCM71Jw==',key_name='tempest-keypair-614548678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-a6bxdson',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=91a32f0f-91a7-4724-ace4-8a333dee6878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=b3e4c67b-c987-4848-830f-e644dd36f5a9,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e4c67b-c9') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'pci_devices' on Instance uuid 91a32f0f-91a7-4724-ace4-8a333dee6878 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:55:52 user nova-compute[73144]:   <uuid>91a32f0f-91a7-4724-ace4-8a333dee6878</uuid>
Aug 14 21:55:52 user nova-compute[73144]:   <name>instance-0000001d</name>
Aug 14 21:55:52 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:55:52 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:55:52 user nova-compute[73144]:   <metadata>
Aug 14 21:55:52 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:55:52 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:55:52 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeNegativeTest-server-969756107</nova:name>
Aug 14 21:55:52 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:55:52</nova:creationTime>
Aug 14 21:55:52 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:55:52 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:55:52 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:55:52 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:55:52 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:55:52 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:55:52 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:55:52 user nova-compute[73144]:       <nova:owner>
Aug 14 21:55:52 user nova-compute[73144]:         <nova:user uuid="597588abcb1a4963a536b2b078ceef23">tempest-AttachVolumeNegativeTest-1600069366-project-member</nova:user>
Aug 14 21:55:52 user nova-compute[73144]:         <nova:project uuid="b004e49247a041b7b00500416a625ca7">tempest-AttachVolumeNegativeTest-1600069366</nova:project>
Aug 14 21:55:52 user nova-compute[73144]:       </nova:owner>
Aug 14 21:55:52 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:55:52 user nova-compute[73144]:       <nova:ports>
Aug 14 21:55:52 user nova-compute[73144]:         <nova:port uuid="b3e4c67b-c987-4848-830f-e644dd36f5a9">
Aug 14 21:55:52 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 21:55:52 user nova-compute[73144]:         </nova:port>
Aug 14 21:55:52 user nova-compute[73144]:       </nova:ports>
Aug 14 21:55:52 user nova-compute[73144]:     </nova:instance>
Aug 14 21:55:52 user nova-compute[73144]:   </metadata>
Aug 14 21:55:52 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:55:52 user nova-compute[73144]:     <system>
Aug 14 21:55:52 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:55:52 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:55:52 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:55:52 user nova-compute[73144]:       <entry name="serial">91a32f0f-91a7-4724-ace4-8a333dee6878</entry>
Aug 14 21:55:52 user nova-compute[73144]:       <entry name="uuid">91a32f0f-91a7-4724-ace4-8a333dee6878</entry>
Aug 14 21:55:52 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:55:52 user nova-compute[73144]:     </system>
Aug 14 21:55:52 user nova-compute[73144]:   </sysinfo>
Aug 14 21:55:52 user nova-compute[73144]:   <os>
Aug 14 21:55:52 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:55:52 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:55:52 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:55:52 user nova-compute[73144]:   </os>
Aug 14 21:55:52 user nova-compute[73144]:   <features>
Aug 14 21:55:52 user nova-compute[73144]:     <acpi/>
Aug 14 21:55:52 user nova-compute[73144]:     <apic/>
Aug 14 21:55:52 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:55:52 user nova-compute[73144]:   </features>
Aug 14 21:55:52 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:55:52 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:55:52 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:55:52 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:55:52 user nova-compute[73144]:   </clock>
Aug 14 21:55:52 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:55:52 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:55:52 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:55:52 user nova-compute[73144]:   </cpu>
Aug 14 21:55:52 user nova-compute[73144]:   <devices>
Aug 14 21:55:52 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:55:52 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:55:52 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk"/>
Aug 14 21:55:52 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:55:52 user nova-compute[73144]:     </disk>
Aug 14 21:55:52 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:55:52 user nova-compute[73144]:       <mac address="fa:16:3e:2c:28:9f"/>
Aug 14 21:55:52 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:52 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:55:52 user nova-compute[73144]:       <target dev="tapb3e4c67b-c9"/>
Aug 14 21:55:52 user nova-compute[73144]:     </interface>
Aug 14 21:55:52 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:55:52 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/console.log" append="off"/>
Aug 14 21:55:52 user nova-compute[73144]:     </serial>
Aug 14 21:55:52 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:55:52 user nova-compute[73144]:     <video>
Aug 14 21:55:52 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:52 user nova-compute[73144]:     </video>
Aug 14 21:55:52 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:55:52 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:55:52 user nova-compute[73144]:     </rng>
Aug 14 21:55:52 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:55:52 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:55:52 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:55:52 user nova-compute[73144]:     </memballoon>
Aug 14 21:55:52 user nova-compute[73144]:   </devices>
Aug 14 21:55:52 user nova-compute[73144]: </domain>
Aug 14 21:55:52 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-969756107',display_name='tempest-AttachVolumeNegativeTest-server-969756107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-969756107',id=29,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBm2HXcxJAFNoQyOa3+GmKXwT37GV7hJNJW3C2dM93JXra0M7VneAY/D9111CAdCxe20X17gnwZ3zLl+5rPM1dkYMVtB9X/Jjlgl9RRUQe3qhaRgxUZO5yjDxgBxCM71Jw==',key_name='tempest-keypair-614548678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-a6bxdson',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=91a32f0f-91a7-4724-ace4-8a333dee6878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=b3e4c67b-c987-4848-830f-e644dd36f5a9,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e4c67b-c9') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG os_vif [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=b3e4c67b-c987-4848-830f-e644dd36f5a9,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e4c67b-c9') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3e4c67b-c9, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3e4c67b-c9, col_values=(('external_ids', {'iface-id': 'b3e4c67b-c987-4848-830f-e644dd36f5a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:28:9f', 'vm-uuid': '91a32f0f-91a7-4724-ace4-8a333dee6878'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:52 user nova-compute[73144]: INFO os_vif [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=b3e4c67b-c987-4848-830f-e644dd36f5a9,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e4c67b-c9')
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:55:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No VIF found with MAC fa:16:3e:2c:28:9f, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:53 user nova-compute[73144]: INFO nova.compute.manager [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Terminating instance
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:55:53 user nova-compute[73144]: INFO nova.compute.claims [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Claim successful on node user
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Successfully updated port: 270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquired lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-ace32667-078c-469e-87fb-a5f5a80913c5 req-e40e8ee2-89e9-496e-afc1-e60b7a80ec53 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ace32667-078c-469e-87fb-a5f5a80913c5 req-e40e8ee2-89e9-496e-afc1-e60b7a80ec53 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ace32667-078c-469e-87fb-a5f5a80913c5 req-e40e8ee2-89e9-496e-afc1-e60b7a80ec53 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ace32667-078c-469e-87fb-a5f5a80913c5 req-e40e8ee2-89e9-496e-afc1-e60b7a80ec53 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-ace32667-078c-469e-87fb-a5f5a80913c5 req-e40e8ee2-89e9-496e-afc1-e60b7a80ec53 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-ace32667-078c-469e-87fb-a5f5a80913c5 req-e40e8ee2-89e9-496e-afc1-e60b7a80ec53 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-changed-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Refreshing instance network info cache due to event network-changed-270080ab-0d5e-4a7a-80ee-a038bbf927a9. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] Acquiring lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updated VIF entry in instance network info cache for port b3e4c67b-c987-4848-830f-e644dd36f5a9. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updating instance_info_cache with network_info: [{"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ebbb30de-c272-415a-8de6-e626e5fd533a req-8baf07bf-75a8-47ba-a82a-78909a37874e service nova] Releasing lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.policy [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89f3461a4f8f45e584180e2b18d782b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842f55070374c288d0e1500d297485e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:55:54 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Creating image(s)
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "/opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "/opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "/opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-de916a2f-66db-4c41-a884-06b4f429dc4a req-a6af7365-30b0-419f-be5f-1f25561dfed0 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-de916a2f-66db-4c41-a884-06b4f429dc4a req-a6af7365-30b0-419f-be5f-1f25561dfed0 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-de916a2f-66db-4c41-a884-06b4f429dc4a req-a6af7365-30b0-419f-be5f-1f25561dfed0 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-de916a2f-66db-4c41-a884-06b4f429dc4a req-a6af7365-30b0-419f-be5f-1f25561dfed0 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-de916a2f-66db-4c41-a884-06b4f429dc4a req-a6af7365-30b0-419f-be5f-1f25561dfed0 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-de916a2f-66db-4c41-a884-06b4f429dc4a req-a6af7365-30b0-419f-be5f-1f25561dfed0 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-4796b9c3-23ac-4eec-8509-ffb653d10123 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating instance_info_cache with network_info: [{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.654s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Releasing lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] Acquired lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.neutron [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Refreshing network info cache for port 270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1409180542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1409180542',id=25,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4t1KtQofX0cMHM3SICsEr2rAdfaE2wiR8BSrzG9+tLGnzk41OqtFUGWr3xM3tag2vxhJoRBCrkHCi8hXw+jUkNYteMdeO7EQMQEcKMBf7Jl6VoLwsx58KOeQPHByasDA==',key_name='tempest-keypair-722661810',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3174ac5ed0da4e0faa1404a52ccc760f',ramdisk_id='',reservation_id='r-oswh5u0r',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-643572001',owner_user_name='tempest-TaggedAttachmentsTest-643572001-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1f449772884d49a1d6355fd3c49908',uuid=89f447d4-22b3-42f7-8830-9facdce3412c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converting VIF {"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=270080ab-0d5e-4a7a-80ee-a038bbf927a9,network=Network(d4497ae2-682a-4c3e-b9ac-e39a742b44d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270080ab-0d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG os_vif [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=270080ab-0d5e-4a7a-80ee-a038bbf927a9,network=Network(d4497ae2-682a-4c3e-b9ac-e39a742b44d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270080ab-0d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:55:55 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Instance destroyed successfully.
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lazy-loading 'resources' on Instance uuid 67dcd12b-616a-4f37-ad82-af85e2226b9c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap270080ab-0d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap270080ab-0d, col_values=(('external_ids', {'iface-id': '270080ab-0d5e-4a7a-80ee-a038bbf927a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:dc:0e', 'vm-uuid': '89f447d4-22b3-42f7-8830-9facdce3412c'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=ea4de1a3-ece8-4141-b210-addf8b81a5ee,network=Network(5cdf94fe-3767-4925-b563-19c604cfb7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4de1a3-ec') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=ea4de1a3-ece8-4141-b210-addf8b81a5ee,network=Network(5cdf94fe-3767-4925-b563-19c604cfb7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4de1a3-ec') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk 1073741824" returned: 0 in 0.109s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: INFO os_vif [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=270080ab-0d5e-4a7a-80ee-a038bbf927a9,network=Network(d4497ae2-682a-4c3e-b9ac-e39a742b44d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270080ab-0d')
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1409180542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1409180542',id=25,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4t1KtQofX0cMHM3SICsEr2rAdfaE2wiR8BSrzG9+tLGnzk41OqtFUGWr3xM3tag2vxhJoRBCrkHCi8hXw+jUkNYteMdeO7EQMQEcKMBf7Jl6VoLwsx58KOeQPHByasDA==',key_name='tempest-keypair-722661810',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3174ac5ed0da4e0faa1404a52ccc760f',ramdisk_id='',reservation_id='r-oswh5u0r',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-643572001',owner_user_name='tempest-TaggedAttachmentsTest-643572001-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1f449772884d49a1d6355fd3c49908',uuid=89f447d4-22b3-42f7-8830-9facdce3412c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converting VIF {"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=270080ab-0d5e-4a7a-80ee-a038bbf927a9,network=Network(d4497ae2-682a-4c3e-b9ac-e39a742b44d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270080ab-0d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea4de1a3-ec, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] attach device xml: <interface type="ethernet">
Aug 14 21:55:55 user nova-compute[73144]:   <mac address="fa:16:3e:90:dc:0e"/>
Aug 14 21:55:55 user nova-compute[73144]:   <model type="virtio"/>
Aug 14 21:55:55 user nova-compute[73144]:   <mtu size="1442"/>
Aug 14 21:55:55 user nova-compute[73144]:   <target dev="tap270080ab-0d"/>
Aug 14 21:55:55 user nova-compute[73144]: </interface>
Aug 14 21:55:55 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.215s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: WARNING nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with vm_state active and task_state deleting.
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: WARNING nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-b4e21ba3-1dd5-4c3d-9572-28e009ce042c for instance with vm_state active and task_state deleting.
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: WARNING nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5 for instance with vm_state active and task_state deleting.
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: WARNING nova.compute.manager [req-5da47b2f-0e78-411f-8c5c-de9a95b17c02 req-7d50ef61-3c91-4e75-b2a2-519746efa226 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 for instance with vm_state active and task_state deleting.
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:55 user nova-compute[73144]: WARNING nova.compute.manager [req-25378dd3-1e36-42f3-9242-4a76ec1ce78b req-9fd474a0-35f7-434d-8300-968b0a5c5c10 service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-fca1c03f-8518-4eed-a927-63c7e1c45b2d for instance with vm_state active and task_state deleting.
Aug 14 21:55:55 user nova-compute[73144]: INFO os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=ea4de1a3-ece8-4141-b210-addf8b81a5ee,network=Network(5cdf94fe-3767-4925-b563-19c604cfb7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4de1a3-ec')
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:44,bridge_name='br-int',has_traffic_filtering=True,id=b4e21ba3-1dd5-4c3d-9572-28e009ce042c,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4e21ba3-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:44,bridge_name='br-int',has_traffic_filtering=True,id=b4e21ba3-1dd5-4c3d-9572-28e009ce042c,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4e21ba3-1d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4e21ba3-1d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Cannot resize image /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'migration_context' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: INFO os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:44,bridge_name='br-int',has_traffic_filtering=True,id=b4e21ba3-1dd5-4c3d-9572-28e009ce042c,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4e21ba3-1d')
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea49fecc-0b') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea49fecc-0b') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Ensure instance console log exists: /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea49fecc-0b, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.neutron [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updated VIF entry in instance network info cache for port 270080ab-0d5e-4a7a-80ee-a038bbf927a9. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.neutron [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating instance_info_cache with network_info: [{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] No BDM found with device name hda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] No VIF found with MAC fa:16:3e:2b:af:d0, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:55:56 user nova-compute[73144]: INFO os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea49fecc-0b')
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:66:9b,bridge_name='br-int',has_traffic_filtering=True,id=fca1c03f-8518-4eed-a927-63c7e1c45b2d,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca1c03f-85') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:66:9b,bridge_name='br-int',has_traffic_filtering=True,id=fca1c03f-8518-4eed-a927-63c7e1c45b2d,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca1c03f-85') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfca1c03f-85, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-34294d43-33ab-4481-8b2e-2155ad945e59 req-b247c6ea-9342-4fd7-9491-096fd506987b service nova] Releasing lock "refresh_cache-89f447d4-22b3-42f7-8830-9facdce3412c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:55:56 user nova-compute[73144]:   <nova:package version="0.0.0"/>
Aug 14 21:55:56 user nova-compute[73144]:   <nova:name>tempest-device-tagging-server-1409180542</nova:name>
Aug 14 21:55:56 user nova-compute[73144]:   <nova:creationTime>2023-08-14 21:55:56</nova:creationTime>
Aug 14 21:55:56 user nova-compute[73144]:   <nova:flavor name="m1.tiny">
Aug 14 21:55:56 user nova-compute[73144]:     <nova:memory>512</nova:memory>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:disk>1</nova:disk>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:swap>0</nova:swap>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:vcpus>1</nova:vcpus>
Aug 14 21:55:56 user nova-compute[73144]:   </nova:flavor>
Aug 14 21:55:56 user nova-compute[73144]:   <nova:owner>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:user uuid="bb1f449772884d49a1d6355fd3c49908">tempest-TaggedAttachmentsTest-643572001-project-member</nova:user>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:project uuid="3174ac5ed0da4e0faa1404a52ccc760f">tempest-TaggedAttachmentsTest-643572001</nova:project>
Aug 14 21:55:56 user nova-compute[73144]:   </nova:owner>
Aug 14 21:55:56 user nova-compute[73144]:   <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:55:56 user nova-compute[73144]:   <nova:ports>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:port uuid="25845491-fe11-4220-8641-c32668bd0b0f">
Aug 14 21:55:56 user nova-compute[73144]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 21:55:56 user nova-compute[73144]:     </nova:port>
Aug 14 21:55:56 user nova-compute[73144]:     <nova:port uuid="270080ab-0d5e-4a7a-80ee-a038bbf927a9">
Aug 14 21:55:56 user nova-compute[73144]:       <nova:ip type="fixed" address="10.10.10.134" ipVersion="4"/>
Aug 14 21:55:56 user nova-compute[73144]:     </nova:port>
Aug 14 21:55:56 user nova-compute[73144]:   </nova:ports>
Aug 14 21:55:56 user nova-compute[73144]: </nova:instance>
Aug 14 21:55:56 user nova-compute[73144]:  {{(pid=73144) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Successfully created port: 70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: INFO os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:66:9b,bridge_name='br-int',has_traffic_filtering=True,id=fca1c03f-8518-4eed-a927-63c7e1c45b2d,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca1c03f-85')
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8e:27,bridge_name='br-int',has_traffic_filtering=True,id=4796b9c3-23ac-4eec-8509-ffb653d10123,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4796b9c3-23') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8e:27,bridge_name='br-int',has_traffic_filtering=True,id=4796b9c3-23ac-4eec-8509-ffb653d10123,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4796b9c3-23') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4796b9c3-23, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e177f17a-894e-4603-be67-cf110dde6e42 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "interface-89f447d4-22b3-42f7-8830-9facdce3412c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.533s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:56 user nova-compute[73144]: INFO os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:8e:27,bridge_name='br-int',has_traffic_filtering=True,id=4796b9c3-23ac-4eec-8509-ffb653d10123,network=Network(f4bb40bf-484f-4248-9075-0ba9f7f73ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4796b9c3-23')
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:9e,bridge_name='br-int',has_traffic_filtering=True,id=48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f70a89-3a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:9e,bridge_name='br-int',has_traffic_filtering=True,id=48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f70a89-3a') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48f70a89-3a, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: INFO os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:9e,bridge_name='br-int',has_traffic_filtering=True,id=48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f70a89-3a')
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820694624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820694624',id=23,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG2WoZWW1fT+gB6IUp1owj6dU/YlEK9X+mmK9i4kh8v6uQAGQT0yLw9ugLXn/ZF/rxfKsg9hKkBtxp1//hE8zSlm3KyhXyf7iacIdKF9ckybHzbeezDcF/rtIiH4zh16g==',key_name='tempest-keypair-811111873',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fe822873f364fd19080cb7b9eb80b05',ramdisk_id='',reservation_id='r-t05mkovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-809499599',owner_user_name='tempest-TaggedBootDevicesTest_v242-809499599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18fdf2b8e2ee449abe89a18894616034',uuid=67dcd12b-616a-4f37-ad82-af85e2226b9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converting VIF {"id": "935a7ffd-3099-4412-98d4-be9ee95301dd", "address": "fa:16:3e:fa:dd:c2", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935a7ffd-30", "ovs_interfaceid": "935a7ffd-3099-4412-98d4-be9ee95301dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:dd:c2,bridge_name='br-int',has_traffic_filtering=True,id=935a7ffd-3099-4412-98d4-be9ee95301dd,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935a7ffd-30') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:dd:c2,bridge_name='br-int',has_traffic_filtering=True,id=935a7ffd-3099-4412-98d4-be9ee95301dd,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935a7ffd-30') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap935a7ffd-30, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:56 user nova-compute[73144]: INFO os_vif [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:dd:c2,bridge_name='br-int',has_traffic_filtering=True,id=935a7ffd-3099-4412-98d4-be9ee95301dd,network=Network(40975c98-fcc0-455d-b70c-d99530c57c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935a7ffd-30')
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RygvTuMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:55:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7847421-3b8b-4063-b9cd-e5537ebd2bed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e46ae-9e0c-4f20-a911-1ae6fceedf33]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158490790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53bead6-a3f2-44a2-8574-76a21acaaaee]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b4cec4-6988-40cb-96de-5d4679f5e7c0]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcea9ce-5727-421b-9d31-cb0cee946eb9]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce74abed-bb27-4962-a072-6742f387f656]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb4367-26b1-4e87-9f94-42d1d87b3b37]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[646622dd-80e3-4905-ab13-ec7491c27f9c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260]
Aug 14 21:55:56 user nova-compute[73144]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342, portal: 172.16.0.220,3260] successful.
Aug 14 21:55:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b98d8f-a7bc-4e67-ae92-c0581e61f342 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c254ae6b-ee0e-4eef-b25c-7b3539c63ae9]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== disconnect_volume: return (364ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwGVqlMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:55:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:56 user nova-compute[73144]: WARNING nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-4796b9c3-23ac-4eec-8509-ffb653d10123 for instance with vm_state active and task_state deleting.
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] No waiting events found dispatching network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:56 user nova-compute[73144]: WARNING nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received unexpected event network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 for instance with vm_state building and task_state spawning.
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] No waiting events found dispatching network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:56 user nova-compute[73144]: WARNING nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received unexpected event network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 for instance with vm_state building and task_state spawning.
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:56 user nova-compute[73144]: WARNING nova.compute.manager [req-1a29e620-c8fc-4885-862a-6114cb5fd533 req-715a6c9e-41e3-4a62-898b-550f1112ebbd service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received unexpected event network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 for instance with vm_state active and task_state None.
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2781acaa-f69c-48d3-9e62-e1fbe17727a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ba5c7-bdd6-4f88-ba68-08fdaee39a84]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158490670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0a9587-2355-4ae2-8e31-49c411407773]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lazy-loading 'flavor' on Instance uuid 89f447d4-22b3-42f7-8830-9facdce3412c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e582475c-68ff-4eb1-831d-3795b15545a9]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f92eb6-d100-4187-b1aa-f16d41101696]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff07c93e-a128-49b9-b939-9c665f33e6d9]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a205d720-4fe7-45f4-a243-5284b8f83dd0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca52f92a-5871-49dc-a359-18e9c3c5f551]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260]
Aug 14 21:55:56 user nova-compute[73144]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208, portal: 172.16.0.220,3260] successful.
Aug 14 21:55:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Rescuing
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.network.neutron [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e5fd13-7e9a-43fc-ad05-2296d22e7208 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f7c7c-6ae2-49eb-8bc9-ace59b442147]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== disconnect_volume: return (369ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Attaching volume 1190f37a-7d7e-4f1b-b376-7d8e476e6aba to /dev/vdb
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqsHyfEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:55:57 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[be74844b-4e19-43f2-b6e0-518b3ce9af66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0bb8d-8cab-4b10-ac14-f6246e987563]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:57 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:57 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab (non-flash)
Aug 14 21:55:57 user nova-compute[73144]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:55:57 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:55:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa15868a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab'): ({'sdf'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Removing single pathed devices sdf {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[61659242-3aaa-4d72-a7d8-372f573774e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.utils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d59c55-7801-4604-98fb-8282ad5640c1]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Flushing IO for device /dev/sdf {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c3673-419f-4124-a665-52b2013a6a46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[64957596-d53a-4c20-a753-eadcecf992ec]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9996a74b-2fe6-48fa-b046-3a6db853c533]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac125a3-7f8b-48f5-b4c0-3403b19e6296]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7e81ff-e68d-4692-9a0b-4ea1a3ae3d9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050157.265389, 91a32f0f-91a7-4724-ace4-8a333dee6878 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] VM Resumed (Lifecycle Event)
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6965880a-d0a6-4065-aba3-ca0c37f47ad0]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:55:57 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[026fe939-ce80-4278-87f4-7e385cffebe2]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.utils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating existing volume attachment record: da1c472f-20ab-44c6-9a25-7f3b746aa2ac {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[474a3d5c-0730-4860-b928-f99f673a0c2e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Instance spawned successfully.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050157.2669063, 91a32f0f-91a7-4724-ace4-8a333dee6878 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] VM Started (Lifecycle Event)
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e185e72e-9ff8-43fb-ac02-13c02abb5e23]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260]
Aug 14 21:55:57 user nova-compute[73144]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab, portal: 172.16.0.220,3260] successful.
Aug 14 21:55:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e6138b4-c75e-4c36-8cc4-c2500f228dab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[208058c9-e489-4b03-816d-d503a538dd0b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] <== disconnect_volume: return (415ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Deleting instance files /opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c_del
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Deletion of /opt/stack/data/nova/instances/67dcd12b-616a-4f37-ad82-af85e2226b9c_del complete
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Took 7.40 seconds to spawn the instance on the hypervisor.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Took 4.40 seconds to destroy the instance on the hypervisor.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:55:57 user nova-compute[73144]: INFO nova.compute.manager [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Took 8.24 seconds to build instance.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Successfully updated port: 70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4e558443-eae2-45bf-a010-272c62502915 tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.457s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquired lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-935a7ffd-3099-4412-98d4-be9ee95301dd for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:57 user nova-compute[73144]: WARNING nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-935a7ffd-3099-4412-98d4-be9ee95301dd for instance with vm_state active and task_state deleting.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:57 user nova-compute[73144]: WARNING nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with vm_state active and task_state deleting.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:57 user nova-compute[73144]: WARNING nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with vm_state active and task_state deleting.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-unplugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-unplugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Acquiring lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] No waiting events found dispatching network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:57 user nova-compute[73144]: WARNING nova.compute.manager [req-067f55e3-15c9-4d60-a280-58694caea3a7 req-572c18f8-8eb7-4fab-9b53-e238ed91e44f service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received unexpected event network-vif-plugged-ea4de1a3-ece8-4141-b210-addf8b81a5ee for instance with vm_state active and task_state deleting.
Aug 14 21:55:57 user nova-compute[73144]: DEBUG nova.network.neutron [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050143.0347915, db61b783-50d7-4304-a031-f9fb11069ef1 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:55:58 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] VM Stopped (Lifecycle Event)
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-31531141-71ca-4f2d-84aa-bb47a9561aa3 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.network.neutron [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updating instance_info_cache with network_info: [{"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Releasing lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Instance network_info: |[{"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Start _get_guest_xml network_info=[{"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:55:58 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:58 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-521759829',display_name='tempest-AttachVolumeTestJSON-server-521759829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-521759829',id=30,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUPF1Sp07RCgK1MoOjEfuDrJcyvavqUXoUj10UDpR3vqxY44n1JEJPkkIbEhfOP83dL1Hz5vHcYVjUXMNDECjgsryUbrbv3fD+VwoW2i+k68cdn+Mfk9/d1mQckCbI6eg==',key_name='tempest-keypair-1002875952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-ww47148b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:55:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=213eeac2-0579-4b7b-b08c-cb040cd54784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=70df378f-2f27-4b41-84e6-0f12ff4b0321,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70df378f-2f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'pci_devices' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:55:58 user nova-compute[73144]:   <uuid>213eeac2-0579-4b7b-b08c-cb040cd54784</uuid>
Aug 14 21:55:58 user nova-compute[73144]:   <name>instance-0000001e</name>
Aug 14 21:55:58 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:55:58 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:55:58 user nova-compute[73144]:   <metadata>
Aug 14 21:55:58 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:55:58 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:55:58 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeTestJSON-server-521759829</nova:name>
Aug 14 21:55:58 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:55:58</nova:creationTime>
Aug 14 21:55:58 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:55:58 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:55:58 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:55:58 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:55:58 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:55:58 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:55:58 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:55:58 user nova-compute[73144]:       <nova:owner>
Aug 14 21:55:58 user nova-compute[73144]:         <nova:user uuid="89f3461a4f8f45e584180e2b18d782b0">tempest-AttachVolumeTestJSON-881893264-project-member</nova:user>
Aug 14 21:55:58 user nova-compute[73144]:         <nova:project uuid="3842f55070374c288d0e1500d297485e">tempest-AttachVolumeTestJSON-881893264</nova:project>
Aug 14 21:55:58 user nova-compute[73144]:       </nova:owner>
Aug 14 21:55:58 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:55:58 user nova-compute[73144]:       <nova:ports>
Aug 14 21:55:58 user nova-compute[73144]:         <nova:port uuid="70df378f-2f27-4b41-84e6-0f12ff4b0321">
Aug 14 21:55:58 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:55:58 user nova-compute[73144]:         </nova:port>
Aug 14 21:55:58 user nova-compute[73144]:       </nova:ports>
Aug 14 21:55:58 user nova-compute[73144]:     </nova:instance>
Aug 14 21:55:58 user nova-compute[73144]:   </metadata>
Aug 14 21:55:58 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:55:58 user nova-compute[73144]:     <system>
Aug 14 21:55:58 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:55:58 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:55:58 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:55:58 user nova-compute[73144]:       <entry name="serial">213eeac2-0579-4b7b-b08c-cb040cd54784</entry>
Aug 14 21:55:58 user nova-compute[73144]:       <entry name="uuid">213eeac2-0579-4b7b-b08c-cb040cd54784</entry>
Aug 14 21:55:58 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:55:58 user nova-compute[73144]:     </system>
Aug 14 21:55:58 user nova-compute[73144]:   </sysinfo>
Aug 14 21:55:58 user nova-compute[73144]:   <os>
Aug 14 21:55:58 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:55:58 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:55:58 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:55:58 user nova-compute[73144]:   </os>
Aug 14 21:55:58 user nova-compute[73144]:   <features>
Aug 14 21:55:58 user nova-compute[73144]:     <acpi/>
Aug 14 21:55:58 user nova-compute[73144]:     <apic/>
Aug 14 21:55:58 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:55:58 user nova-compute[73144]:   </features>
Aug 14 21:55:58 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:55:58 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:55:58 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:55:58 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:55:58 user nova-compute[73144]:   </clock>
Aug 14 21:55:58 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:55:58 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:55:58 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:55:58 user nova-compute[73144]:   </cpu>
Aug 14 21:55:58 user nova-compute[73144]:   <devices>
Aug 14 21:55:58 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:55:58 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:55:58 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk"/>
Aug 14 21:55:58 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:55:58 user nova-compute[73144]:     </disk>
Aug 14 21:55:58 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:55:58 user nova-compute[73144]:       <mac address="fa:16:3e:6b:9a:63"/>
Aug 14 21:55:58 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:58 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:55:58 user nova-compute[73144]:       <target dev="tap70df378f-2f"/>
Aug 14 21:55:58 user nova-compute[73144]:     </interface>
Aug 14 21:55:58 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:55:58 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/console.log" append="off"/>
Aug 14 21:55:58 user nova-compute[73144]:     </serial>
Aug 14 21:55:58 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:55:58 user nova-compute[73144]:     <video>
Aug 14 21:55:58 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:55:58 user nova-compute[73144]:     </video>
Aug 14 21:55:58 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:55:58 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:55:58 user nova-compute[73144]:     </rng>
Aug 14 21:55:58 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:55:58 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:55:58 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:55:58 user nova-compute[73144]:     </memballoon>
Aug 14 21:55:58 user nova-compute[73144]:   </devices>
Aug 14 21:55:58 user nova-compute[73144]: </domain>
Aug 14 21:55:58 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-521759829',display_name='tempest-AttachVolumeTestJSON-server-521759829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-521759829',id=30,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUPF1Sp07RCgK1MoOjEfuDrJcyvavqUXoUj10UDpR3vqxY44n1JEJPkkIbEhfOP83dL1Hz5vHcYVjUXMNDECjgsryUbrbv3fD+VwoW2i+k68cdn+Mfk9/d1mQckCbI6eg==',key_name='tempest-keypair-1002875952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-ww47148b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:55:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=213eeac2-0579-4b7b-b08c-cb040cd54784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=70df378f-2f27-4b41-84e6-0f12ff4b0321,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70df378f-2f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG os_vif [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=70df378f-2f27-4b41-84e6-0f12ff4b0321,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70df378f-2f') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70df378f-2f, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70df378f-2f, col_values=(('external_ids', {'iface-id': '70df378f-2f27-4b41-84e6-0f12ff4b0321', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:9a:63', 'vm-uuid': '213eeac2-0579-4b7b-b08c-cb040cd54784'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: INFO os_vif [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=70df378f-2f27-4b41-84e6-0f12ff4b0321,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70df378f-2f')
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No VIF found with MAC fa:16:3e:6b:9a:63, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:58 user nova-compute[73144]: WARNING nova.compute.manager [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received unexpected event network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 for instance with vm_state active and task_state None.
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-changed-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Refreshing instance network info cache due to event network-changed-70df378f-2f27-4b41-84e6-0f12ff4b0321. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] Acquiring lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] Acquired lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:55:58 user nova-compute[73144]: DEBUG nova.network.neutron [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Refreshing network info cache for port 70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.network.neutron [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updated VIF entry in instance network info cache for port 70df378f-2f27-4b41-84e6-0f12ff4b0321. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.network.neutron [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updating instance_info_cache with network_info: [{"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47488ff4-531b-4541-ad85-a3ba64ed34b6 req-d15dc242-66de-4222-af3d-3923595f3dde service nova] Releasing lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 21:55:59 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance destroyed successfully.
Aug 14 21:55:59 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Attempting a stable device rescue
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73144) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 21:55:59 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Creating image(s)
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "/opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.objects.instance [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "7191dcfc84b245de8d61fc94ef3d7fecf1520b5a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "7191dcfc84b245de8d61fc94ef3d7fecf1520b5a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:59 user nova-compute[73144]: WARNING nova.compute.manager [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state active and task_state rescuing.
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:55:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:55:59 user nova-compute[73144]: WARNING nova.compute.manager [req-842f5834-b1fb-4a38-b5b5-635cf5949635 req-09aed0c9-f549-477d-b04c-ea3732eac8ac service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state active and task_state rescuing.
Aug 14 21:56:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-71f2860e-1826-43e3-a901-cbb8f38e5577 req-538abafb-c44f-4767-b9e3-9933e5471c53 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-71f2860e-1826-43e3-a901-cbb8f38e5577 req-538abafb-c44f-4767-b9e3-9933e5471c53 service nova] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-71f2860e-1826-43e3-a901-cbb8f38e5577 req-538abafb-c44f-4767-b9e3-9933e5471c53 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-71f2860e-1826-43e3-a901-cbb8f38e5577 req-538abafb-c44f-4767-b9e3-9933e5471c53 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-71f2860e-1826-43e3-a901-cbb8f38e5577 req-538abafb-c44f-4767-b9e3-9933e5471c53 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] No waiting events found dispatching network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:56:01 user nova-compute[73144]: WARNING nova.compute.manager [req-71f2860e-1826-43e3-a901-cbb8f38e5577 req-538abafb-c44f-4767-b9e3-9933e5471c53 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received unexpected event network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 for instance with vm_state building and task_state spawning.
Aug 14 21:56:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.part --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG nova.virt.images [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] 38650101-76bf-4ed4-91d8-367d448c87cd was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.part /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-deleted-935a7ffd-3099-4412-98d4-be9ee95301dd {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:01 user nova-compute[73144]: INFO nova.compute.manager [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Neutron deleted interface 935a7ffd-3099-4412-98d4-be9ee95301dd; detaching it from the instance and deleting it from the info cache
Aug 14 21:56:01 user nova-compute[73144]: DEBUG nova.network.neutron [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [{"id": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "address": "fa:16:3e:c5:4b:7d", "network": {"id": "5cdf94fe-3767-4925-b563-19c604cfb7a6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-63155392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4de1a3-ec", "ovs_interfaceid": "ea4de1a3-ece8-4141-b210-addf8b81a5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:56:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.part /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.converted" returned: 0 in 0.545s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Detach interface failed, port_id=935a7ffd-3099-4412-98d4-be9ee95301dd, reason: Instance 67dcd12b-616a-4f37-ad82-af85e2226b9c could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-deleted-ea4de1a3-ece8-4141-b210-addf8b81a5ee {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:02 user nova-compute[73144]: INFO nova.compute.manager [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Neutron deleted interface ea4de1a3-ece8-4141-b210-addf8b81a5ee; detaching it from the instance and deleting it from the info cache
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [{"id": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "address": "fa:16:3e:94:d8:44", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e21ba3-1d", "ovs_interfaceid": "b4e21ba3-1dd5-4c3d-9572-28e009ce042c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "address": "fa:16:3e:86:ab:2a", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea49fecc-0b", "ovs_interfaceid": "ea49fecc-0b3c-491c-90a7-8ef8dc1d66b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "address": "fa:16:3e:35:66:9b", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca1c03f-85", "ovs_interfaceid": "fca1c03f-8518-4eed-a927-63c7e1c45b2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4796b9c3-23ac-4eec-8509-ffb653d10123", "address": "fa:16:3e:cb:8e:27", "network": {"id": "f4bb40bf-484f-4248-9075-0ba9f7f73ef0", "bridge": "br-int", "label": "tempest-device-tagging-net1-861531209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4796b9c3-23", "ovs_interfaceid": "4796b9c3-23ac-4eec-8509-ffb653d10123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "address": "fa:16:3e:05:e6:9e", "network": {"id": "40975c98-fcc0-455d-b70c-d99530c57c9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-337796065", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fe822873f364fd19080cb7b9eb80b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f70a89-3a", "ovs_interfaceid": "48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1895be7-6908-4844-9b4f-d3afa20950b9 req-8aa807c8-8457-4edc-8053-d5e5f1a6884c service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Detach interface failed, port_id=ea4de1a3-ece8-4141-b210-addf8b81a5ee, reason: Instance 67dcd12b-616a-4f37-ad82-af85e2226b9c could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "7191dcfc84b245de8d61fc94ef3d7fecf1520b5a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.343s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "7191dcfc84b245de8d61fc94ef3d7fecf1520b5a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "7191dcfc84b245de8d61fc94ef3d7fecf1520b5a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a,backing_fmt=raw /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a,backing_fmt=raw /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue" returned: 0 in 0.052s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "7191dcfc84b245de8d61fc94ef3d7fecf1520b5a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'migration_context' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Start _get_guest_xml network_info=[{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "vif_mac": "fa:16:3e:15:de:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '38650101-76bf-4ed4-91d8-367d448c87cd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'db67e0ac-5dfa-4ca8-b56a-34b021079d3b', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPABoKSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5229a303-2dad-45a6-b140-29a55d8d29a7', 'attached_at': '', 'detached_at': '', 'volume_id': '87b56623-f20c-428c-9ea2-ac2f0eeba823', 'serial': '87b56623-f20c-428c-9ea2-ac2f0eeba823'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'resources' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'numa_topology' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:56:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPABoKSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:56:02 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:56:02 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:56:02 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-da86e92f-3cdb-4887-8f3b-3bf187115795 req-9f041161-1e6c-4cb9-b3ba-5a8158fa6291 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-da86e92f-3cdb-4887-8f3b-3bf187115795 req-9f041161-1e6c-4cb9-b3ba-5a8158fa6291 service nova] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-da86e92f-3cdb-4887-8f3b-3bf187115795 req-9f041161-1e6c-4cb9-b3ba-5a8158fa6291 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-da86e92f-3cdb-4887-8f3b-3bf187115795 req-9f041161-1e6c-4cb9-b3ba-5a8158fa6291 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-da86e92f-3cdb-4887-8f3b-3bf187115795 req-9f041161-1e6c-4cb9-b3ba-5a8158fa6291 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] No waiting events found dispatching network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:56:02 user nova-compute[73144]: WARNING nova.compute.manager [req-da86e92f-3cdb-4887-8f3b-3bf187115795 req-9f041161-1e6c-4cb9-b3ba-5a8158fa6291 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received unexpected event network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 for instance with vm_state building and task_state spawning.
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[80487396-6c95-4e8d-a84a-c6372ae613da]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uPABoKSl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 21:56:02 user nova-compute[73144]: node.name = iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823
Aug 14 21:56:02 user nova-compute[73144]: node.tpgt = -1
Aug 14 21:56:02 user nova-compute[73144]: node.startup = automatic
Aug 14 21:56:02 user nova-compute[73144]: node.leading_login = No
Aug 14 21:56:02 user nova-compute[73144]: iface.iscsi_ifacename = default
Aug 14 21:56:02 user nova-compute[73144]: iface.net_ifacename = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.ipaddress = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.prefix_len = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.hwaddress = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.transport_name = tcp
Aug 14 21:56:02 user nova-compute[73144]: iface.initiatorname = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.state = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.vlan_id = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.vlan_priority = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.vlan_state = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.iface_num = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.mtu = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.port = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.bootproto = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.subnet_mask = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.gateway = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_alt_client_id = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_dns = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_learn_iqn = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_vendor_id_state = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_vendor_id = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.dhcp_slp_da = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.fragmentation = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.gratuitous_arp = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.incoming_forwarding = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.tos_state = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.tos = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.ttl = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.delayed_ack = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.tcp_nagle = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.tcp_wsf_state = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.tcp_wsf = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.tcp_timer_scale = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.tcp_timestamp = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.redirect = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.def_task_mgmt_timeout = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.header_digest = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.data_digest = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.immediate_data = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.initial_r2t = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.data_seq_inorder = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.data_pdu_inorder = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.erl = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.max_receive_data_len = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.first_burst_len = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.max_outstanding_r2t = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.max_burst_len = 0
Aug 14 21:56:02 user nova-compute[73144]: iface.chap_auth = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.bidi_chap = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.strict_login_compliance = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.discovery_auth = <empty>
Aug 14 21:56:02 user nova-compute[73144]: iface.discovery_logout = <empty>
Aug 14 21:56:02 user nova-compute[73144]: node.discovery_address = <empty>
Aug 14 21:56:02 user nova-compute[73144]: node.discovery_port = 0
Aug 14 21:56:02 user nova-compute[73144]: node.discovery_type = static
Aug 14 21:56:02 user nova-compute[73144]: node.session.initial_cmdsn = 0
Aug 14 21:56:02 user nova-compute[73144]: node.session.initial_login_retry_max = 8
Aug 14 21:56:02 user nova-compute[73144]: node.session.xmit_thread_priority = -20
Aug 14 21:56:02 user nova-compute[73144]: node.session.cmds_max = 128
Aug 14 21:56:02 user nova-compute[73144]: node.session.queue_depth = 32
Aug 14 21:56:02 user nova-compute[73144]: node.session.nr_sessions = 1
Aug 14 21:56:02 user nova-compute[73144]: node.session.auth.authmethod = CHAP
Aug 14 21:56:02 user nova-compute[73144]: node.session.auth.username = uPABoKSl
Aug 14 21:56:02 user nova-compute[73144]: node.session.auth.password = ***
Aug 14 21:56:02 user nova-compute[73144]: node.session.auth.username_in = <empty>
Aug 14 21:56:02 user nova-compute[73144]: node.session.auth.password_in = <empty>
Aug 14 21:56:02 user nova-compute[73144]: node.session.auth.chap_algs = MD5
Aug 14 21:56:02 user nova-compute[73144]: node.session.timeo.replacement_timeout = 120
Aug 14 21:56:02 user nova-compute[73144]: node.session.err_timeo.abort_timeout = 15
Aug 14 21:56:02 user nova-compute[73144]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 21:56:02 user nova-compute[73144]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 21:56:02 user nova-compute[73144]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.FastAbort = Yes
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.InitialR2T = No
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.ImmediateData = Yes
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.MaxConnections = 1
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 21:56:02 user nova-compute[73144]: node.session.iscsi.ERL = 0
Aug 14 21:56:02 user nova-compute[73144]: node.session.scan = manual
Aug 14 21:56:02 user nova-compute[73144]: node.session.reopen_max = 0
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].address = 172.16.0.220
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].port = 3260
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].startup = manual
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].tcp.window_size = 524288
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].tcp.type_of_service = 0
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].timeo.logout_timeout = 15
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].timeo.login_timeout = 15
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].timeo.auth_timeout = 45
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].iscsi.DataDigest = None
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].iscsi.IFMarker = No
Aug 14 21:56:02 user nova-compute[73144]: node.conn[0].iscsi.OFMarker = No
Aug 14 21:56:02 user nova-compute[73144]: # END RECORD
Aug 14 21:56:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e44798-2cf2-47aa-8e0e-1b149883dd80]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[31780433-d0ac-4d7e-831c-e331cc649dac]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPABoKSl {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPABoKSl" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cf7589-6269-401c-a5c0-20404066c1ae]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPABoKSl'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdf14eb-e401-4f3f-bc47-486e76092e03]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b79b2-cc0b-4d72-9f5d-c4b009d8f40f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:02 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:02 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] HCTL ('34', '0', '0', 0) found on session 27 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[96900335-f6d1-44eb-8c4c-05e9e08ad275]: (4, ('0 0 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching for a device in session 27 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPABoKSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '23161643162373431', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643162373431', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:54:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912081673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912081673',id=26,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-zieqpqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:54:29Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=5229a303-2dad-45a6-b140-29a55d8d29a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "vif_mac": "fa:16:3e:15:de:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "vif_mac": "fa:16:3e:15:de:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'pci_devices' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:02 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Took 5.28 seconds to deallocate network for instance.
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:56:02 user nova-compute[73144]:   <uuid>5229a303-2dad-45a6-b140-29a55d8d29a7</uuid>
Aug 14 21:56:02 user nova-compute[73144]:   <name>instance-0000001a</name>
Aug 14 21:56:02 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:56:02 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:56:02 user nova-compute[73144]:   <metadata>
Aug 14 21:56:02 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:56:02 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:56:02 user nova-compute[73144]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1912081673</nova:name>
Aug 14 21:56:02 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:56:02</nova:creationTime>
Aug 14 21:56:02 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:56:02 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:56:02 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:56:02 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:56:02 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:56:02 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:56:02 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:56:02 user nova-compute[73144]:       <nova:owner>
Aug 14 21:56:02 user nova-compute[73144]:         <nova:user uuid="cfe8b1fc0405438c99d3edd956e103a4">tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member</nova:user>
Aug 14 21:56:02 user nova-compute[73144]:         <nova:project uuid="59e45dfdc13e486e950f6bc8595bb8fa">tempest-ServerBootFromVolumeStableRescueTest-847208830</nova:project>
Aug 14 21:56:02 user nova-compute[73144]:       </nova:owner>
Aug 14 21:56:02 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:56:02 user nova-compute[73144]:       <nova:ports>
Aug 14 21:56:02 user nova-compute[73144]:         <nova:port uuid="b3326f41-f503-40b1-a924-be55d27143a1">
Aug 14 21:56:02 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:56:02 user nova-compute[73144]:         </nova:port>
Aug 14 21:56:02 user nova-compute[73144]:       </nova:ports>
Aug 14 21:56:02 user nova-compute[73144]:     </nova:instance>
Aug 14 21:56:02 user nova-compute[73144]:   </metadata>
Aug 14 21:56:02 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:56:02 user nova-compute[73144]:     <system>
Aug 14 21:56:02 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:56:02 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:56:02 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:56:02 user nova-compute[73144]:       <entry name="serial">5229a303-2dad-45a6-b140-29a55d8d29a7</entry>
Aug 14 21:56:02 user nova-compute[73144]:       <entry name="uuid">5229a303-2dad-45a6-b140-29a55d8d29a7</entry>
Aug 14 21:56:02 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:56:02 user nova-compute[73144]:     </system>
Aug 14 21:56:02 user nova-compute[73144]:   </sysinfo>
Aug 14 21:56:02 user nova-compute[73144]:   <os>
Aug 14 21:56:02 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:56:02 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:56:02 user nova-compute[73144]:   </os>
Aug 14 21:56:02 user nova-compute[73144]:   <features>
Aug 14 21:56:02 user nova-compute[73144]:     <acpi/>
Aug 14 21:56:02 user nova-compute[73144]:     <apic/>
Aug 14 21:56:02 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:56:02 user nova-compute[73144]:   </features>
Aug 14 21:56:02 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:56:02 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:56:02 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:56:02 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:56:02 user nova-compute[73144]:   </clock>
Aug 14 21:56:02 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:56:02 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:56:02 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:56:02 user nova-compute[73144]:   </cpu>
Aug 14 21:56:02 user nova-compute[73144]:   <devices>
Aug 14 21:56:02 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:56:02 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:56:02 user nova-compute[73144]:       <source dev="/dev/sdc"/>
Aug 14 21:56:02 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:56:02 user nova-compute[73144]:       <serial>87b56623-f20c-428c-9ea2-ac2f0eeba823</serial>
Aug 14 21:56:02 user nova-compute[73144]:     </disk>
Aug 14 21:56:02 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:56:02 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:56:02 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue"/>
Aug 14 21:56:02 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 21:56:02 user nova-compute[73144]:       <boot order="1"/>
Aug 14 21:56:02 user nova-compute[73144]:     </disk>
Aug 14 21:56:02 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:56:02 user nova-compute[73144]:       <mac address="fa:16:3e:15:de:d2"/>
Aug 14 21:56:02 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:56:02 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:56:02 user nova-compute[73144]:       <target dev="tapb3326f41-f5"/>
Aug 14 21:56:02 user nova-compute[73144]:     </interface>
Aug 14 21:56:02 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:56:02 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/console.log" append="off"/>
Aug 14 21:56:02 user nova-compute[73144]:     </serial>
Aug 14 21:56:02 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:56:02 user nova-compute[73144]:     <video>
Aug 14 21:56:02 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:56:02 user nova-compute[73144]:     </video>
Aug 14 21:56:02 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:56:02 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:56:02 user nova-compute[73144]:     </rng>
Aug 14 21:56:02 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:56:02 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:56:02 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:56:02 user nova-compute[73144]:     </memballoon>
Aug 14 21:56:02 user nova-compute[73144]:   </devices>
Aug 14 21:56:02 user nova-compute[73144]: </domain>
Aug 14 21:56:02 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:56:02 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance destroyed successfully.
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No VIF found with MAC fa:16:3e:15:de:d2, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050162.9276123, 213eeac2-0579-4b7b-b08c-cb040cd54784 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:56:02 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] VM Resumed (Lifecycle Event)
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:56:02 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Instance spawned successfully.
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:56:02 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:56:02 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050162.9338987, 213eeac2-0579-4b7b-b08c-cb040cd54784 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:56:02 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] VM Started (Lifecycle Event)
Aug 14 21:56:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:56:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:56:03 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:56:03 user nova-compute[73144]: INFO nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Took 8.60 seconds to spawn the instance on the hypervisor.
Aug 14 21:56:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:56:03 user nova-compute[73144]: INFO nova.compute.manager [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Took 9.73 seconds to build instance.
Aug 14 21:56:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c20ceacb-659d-449b-a0c9-4000b903809f tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.878s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-570a4c2f-e5f0-4682-94a3-29c396835e24 req-fee4214f-fd77-4a75-87a2-47f7d8f9cd4a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-deleted-4796b9c3-23ac-4eec-8509-ffb653d10123 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-570a4c2f-e5f0-4682-94a3-29c396835e24 req-fee4214f-fd77-4a75-87a2-47f7d8f9cd4a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-deleted-fca1c03f-8518-4eed-a927-63c7e1c45b2d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-570a4c2f-e5f0-4682-94a3-29c396835e24 req-fee4214f-fd77-4a75-87a2-47f7d8f9cd4a service nova] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Received event network-vif-deleted-48f70a89-3a4c-4288-83a2-e5cb4ab9b8a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:05 user nova-compute[73144]: INFO nova.compute.manager [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Took 2.66 seconds to detach 3 volumes for instance.
Aug 14 21:56:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:05 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 21:56:05 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 21:56:05 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 21:56:05 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.volume.cinder [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Update attachment failed for attachment da1c472f-20ab-44c6-9a25-7f3b746aa2ac. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-af526bb9-5879-457f-bd7f-114d3f97e72e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-af526bb9-5879-457f-bd7f-114d3f97e72e)
Aug 14 21:56:05 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Failed to attach 1190f37a-7d7e-4f1b-b376-7d8e476e6aba at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-af526bb9-5879-457f-bd7f-114d3f97e72e)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Traceback (most recent call last):
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     ret_val = method(obj, context, *args, **kwargs)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     self._do_attach(context, instance, volume, volume_api,
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     self._volume_attach(context, volume, connector, instance,
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     connection_info = volume_api.attachment_update(
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     res = method(self, ctx, *args, **kwargs)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     with excutils.save_and_reraise_exception():
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     self.force_reraise()
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     raise self.value
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     return method.func(obj, *args, **kwargs)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     resp = self._update('/attachments/%s' % id, body)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     return self.request(url, method, **kwargs)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c]     raise exceptions.from_response(resp, body)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-af526bb9-5879-457f-bd7f-114d3f97e72e)
Aug 14 21:56:05 user nova-compute[73144]: ERROR nova.compute.manager [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] 
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.990s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server [None req-2804f66f-a13c-45a5-95dd-6543f971b192 tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-af526bb9-5879-457f-bd7f-114d3f97e72e)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1190f37a-7d7e-4f1b-b376-7d8e476e6aba/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-af526bb9-5879-457f-bd7f-114d3f97e72e)
Aug 14 21:56:06 user nova-compute[73144]: ERROR oslo_messaging.rpc.server 
Aug 14 21:56:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:56:06 user nova-compute[73144]: WARNING nova.compute.manager [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state active and task_state rescuing.
Aug 14 21:56:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:56:06 user nova-compute[73144]: WARNING nova.compute.manager [req-aa152110-d243-4979-a4b1-a735d00ca62b req-ccbbdbe7-f73e-416f-bff0-23f07981c538 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state active and task_state rescuing.
Aug 14 21:56:06 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.732s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:06 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Deleted allocations for instance 67dcd12b-616a-4f37-ad82-af85e2226b9c
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3cce8e-cd07-447c-b221-21570fe83efc tempest-TaggedBootDevicesTest_v242-809499599 tempest-TaggedBootDevicesTest_v242-809499599-project-member] Lock "67dcd12b-616a-4f37-ad82-af85e2226b9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.293s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:56:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for 5229a303-2dad-45a6-b140-29a55d8d29a7 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050167.0952532, 5229a303-2dad-45a6-b140-29a55d8d29a7 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:56:07 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] VM Resumed (Lifecycle Event)
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-04217608-8b74-461d-855e-3c55f2bb9582 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:56:07 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050167.0963814, 5229a303-2dad-45a6-b140-29a55d8d29a7 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:56:07 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] VM Started (Lifecycle Event)
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050155.0985, 67dcd12b-616a-4f37-ad82-af85e2226b9c => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:56:10 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] VM Stopped (Lifecycle Event)
Aug 14 21:56:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-867ee28f-33ab-4bc7-8686-2b2dc51922b8 None None] [instance: 67dcd12b-616a-4f37-ad82-af85e2226b9c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:11 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:56:11 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:56:11 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=25.287464141845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 89f447d4-22b3-42f7-8830-9facdce3412c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b5d5bf63-c36b-49d4-9b1a-3b0400da8316 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 91a32f0f-91a7-4724-ace4-8a333dee6878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 213eeac2-0579-4b7b-b08c-cb040cd54784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:56:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-changed-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Refreshing instance network info cache due to event network-changed-6b98003c-89e7-4f8a-a57c-426f0dab822a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] Acquiring lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] Acquired lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Refreshing network info cache for port 6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updated VIF entry in instance network info cache for port 6b98003c-89e7-4f8a-a57c-426f0dab822a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updating instance_info_cache with network_info: [{"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:56:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-297ae511-f9d1-4f3d-9b64-ad57a8dd0f8d req-68c918e5-f8a6-4cee-ae3d-4d58d4614cb2 service nova] Releasing lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'flavor' on Instance uuid 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:15 user nova-compute[73144]: INFO nova.compute.manager [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Attaching volume 4fde10de-25d9-4b4e-b756-7639d752d338 to /dev/vdb
Aug 14 21:56:15 user nova-compute[73144]: DEBUG os_brick.utils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6939437c-f9ac-4d00-a2c1-e9ba12657677]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab095af-ce67-43bc-83b3-fcb9e1a6eda2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24001b2-3f78-49ce-be41-bd13dbc844a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2397db-258b-4bcd-9fa0-968768284cf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:56:15 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:56:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e0bbb3-84d3-4665-8831-ef5ad97bef84]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG os_brick.utils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:56:15 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updating existing volume attachment record: eefb4ddd-4362-4757-ae9b-5dccfad6b584 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:56:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OamuZCsP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:56:23 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:56:23 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:56:23 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fef486-01a5-4adf-b6fa-33af3412ceab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:56:23 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5585ae32-c41b-4272-807e-a50518b28996]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338] added
Aug 14 21:56:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c9465-c850-4389-9f78-e532fdef1112]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b3def9-54d3-42cd-97a6-62622ad6d917]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OamuZCsP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OamuZCsP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db311b9-3e44-46cb-ac95-6302a4551dd0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OamuZCsP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3215adc-4d8a-49fa-a5a6-114d124f6d05]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c5485a-1b1e-4872-881f-bfbe72102e03]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0423b628-607d-4e38-be10-c17a04693567]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260]
Aug 14 21:56:24 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260] successful.
Aug 14 21:56:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d251b2-cb94-48f2-b734-8ca02ad1d59b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[76110ed7-c399-49c9-9c82-03877ef7d928]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 (non-flash)
Aug 14 21:56:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[50959821-8453-4e63-b3ae-c4192c2dd8f5]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:56:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OamuZCsP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26462333164643035', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462333164643035', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG nova.objects.instance [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'flavor' on Instance uuid 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:56:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:56:25 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:56:25 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:56:25 user nova-compute[73144]:   <serial>4fde10de-25d9-4b4e-b756-7639d752d338</serial>
Aug 14 21:56:25 user nova-compute[73144]: </disk>
Aug 14 21:56:25 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No VIF found with MAC fa:16:3e:13:43:a5, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:56:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-02ef5bd3-6d5c-43c9-87e3-21beee833156 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.584s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:27 user nova-compute[73144]: INFO nova.compute.manager [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Detaching volume 4fde10de-25d9-4b4e-b756-7639d752d338
Aug 14 21:56:27 user nova-compute[73144]: INFO nova.virt.block_device [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Attempting to driver detach volume 4fde10de-25d9-4b4e-b756-7639d752d338 from mountpoint /dev/vdb
Aug 14 21:56:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Attempting to detach device vdb from instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:56:27 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:56:27 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:56:27 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:56:27 user nova-compute[73144]:   <serial>4fde10de-25d9-4b4e-b756-7639d752d338</serial>
Aug 14 21:56:27 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:56:27 user nova-compute[73144]: </disk>
Aug 14 21:56:27 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:56:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully detached device vdb from instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 from the persistent domain config.
Aug 14 21:56:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:56:27 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:56:27 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 21:56:27 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:56:27 user nova-compute[73144]:   <serial>4fde10de-25d9-4b4e-b756-7639d752d338</serial>
Aug 14 21:56:27 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:56:27 user nova-compute[73144]: </disk>
Aug 14 21:56:27 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050187.9014227, 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:56:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully detached device vdb from instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 from the live domain config.
Aug 14 21:56:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OamuZCsP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:56:27 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2c66c9-4a56-47a7-b2e1-42cf1bc6ec6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ba449-4c21-48ec-980e-12562cb002af]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:27 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:27 user nova-compute[73144]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 (non-flash)
Aug 14 21:56:27 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:27 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:27 user nova-compute[73144]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 (non-flash)
Aug 14 21:56:27 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17865da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[877a8d29-2876-4952-bed2-aa08c84a1311]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f57621a-dd65-40ea-8744-26daea4e9ec2]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7916afb-0b53-4b9d-9777-5ebd6e29a826]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab1f3a-b458-475d-b2e0-e0b8dc8cf6f3]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[953c8cce-d335-49d2-9043-b7f8333a9aa5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a675b346-1735-41c3-9759-cc28c363f09b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260]
Aug 14 21:56:28 user nova-compute[73144]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338, portal: 172.16.0.220,3260] successful.
Aug 14 21:56:28 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fde10de-25d9-4b4e-b756-7639d752d338 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1848861-0cda-4208-a05c-0bc7f11c2e1f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] <== disconnect_volume: return (278ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'flavor' on Instance uuid 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:56:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c6f006d9-8110-4d03-8184-ec03319611c7 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.551s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:56:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:56:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:49 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:56:49 user nova-compute[73144]: INFO nova.compute.claims [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Claim successful on node user
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.network.neutron [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:56:50 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:56:50 user nova-compute[73144]: INFO nova.virt.block_device [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Booting with volume 582a8584-1c29-4bc1-ab9a-fac4705091d2 at /dev/vda
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.policy [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f236788f6a93453b893ddf6d4cf01c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2005f37baf4b1b99effc98fddd0fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG os_brick.utils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aaf8ba-0ef2-4a2d-9c5d-7eabe9c5e4dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5fb9c-7635-485b-92c6-2d7fc535ac1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[573fd38d-28cc-47ff-92d9-fe66f182b170]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b8b35-44f3-43f3-873c-5a7f8c1de6f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:56:50 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:56:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16984b-8345-463d-8b35-a19def683e5b]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG os_brick.utils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating existing volume attachment record: b8c09c89-565b-457c-af75-2b1132993782 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:56:50 user nova-compute[73144]: DEBUG nova.network.neutron [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Successfully created port: 648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG nova.network.neutron [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Successfully updated port: 648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquired lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG nova.network.neutron [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-changed-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Refreshing instance network info cache due to event network-changed-648e988b-1d10-4829-932b-88c863dc0cfa. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] Acquiring lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:56:51 user nova-compute[73144]: DEBUG nova.network.neutron [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG nova.network.neutron [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating instance_info_cache with network_info: [{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Releasing lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance network_info: |[{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] Acquired lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG nova.network.neutron [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Refreshing network info cache for port 648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG nova.network.neutron [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updated VIF entry in instance network info cache for port 648e988b-1d10-4829-932b-88c863dc0cfa. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG nova.network.neutron [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating instance_info_cache with network_info: [{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:56:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b199646f-2339-473d-a2a8-442550d933c9 req-c8997f40-508f-49e5-9118-8f785bbd3b7a service nova] Releasing lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:56:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:56:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:56:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:56:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:56:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:56:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:56:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:56:59 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Creating image(s)
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Ensure instance console log exists: /opt/stack/data/nova/instances/37ba2c90-f471-4c24-ada2-084734722610/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Start _get_guest_xml network_info=[{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'b8c09c89-565b-457c-af75-2b1132993782', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37ba2c90-f471-4c24-ada2-084734722610', 'attached_at': '', 'detached_at': '', 'volume_id': '582a8584-1c29-4bc1-ab9a-fac4705091d2', 'serial': '582a8584-1c29-4bc1-ab9a-fac4705091d2'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:56:59 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:56:59 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:56:59 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:56:59 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:56:59 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b2c2d6-58ae-4e95-b67f-c8ab61ca93cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:56:59 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cf4eba-e5fa-4066-b261-9806f29cdc10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2] added
Aug 14 21:56:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[47985995-7ae0-499d-8955-6fdeb21f93f8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfb8dc1-5e3a-46d1-b02e-9a125a3fbaca]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnzgOpiN {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnzgOpiN" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e628a2-07cf-42dd-be6b-f4d9f4565f26]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GnzgOpiN'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c24e73b-2d81-4a2f-a5f2-e6420aa86687]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab10d2b-c97b-4b84-993e-0f231101e40b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b8017-6384-41e6-9b25-4f4adb777dda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]
Aug 14 21:56:59 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.
Aug 14 21:56:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680bf72-633f-4320-82ae-085102bfc23d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[03049613-7fa3-4be7-b6cd-953c41930b96]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:56:59 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc69ac2-a20b-4414-aefc-f8ceb1010d5f]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:56:59 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26639623861383731', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639623861383731', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-446237050',display_name='tempest-ServerActionsTestOtherA-server-446237050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-446237050',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-0tv7sgub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=37ba2c90-f471-4c24-ada2-084734722610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG nova.objects.instance [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'pci_devices' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:57:00 user nova-compute[73144]:   <uuid>37ba2c90-f471-4c24-ada2-084734722610</uuid>
Aug 14 21:57:00 user nova-compute[73144]:   <name>instance-0000001f</name>
Aug 14 21:57:00 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:57:00 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:57:00 user nova-compute[73144]:   <metadata>
Aug 14 21:57:00 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:57:00 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:57:00 user nova-compute[73144]:       <nova:name>tempest-ServerActionsTestOtherA-server-446237050</nova:name>
Aug 14 21:57:00 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:56:59</nova:creationTime>
Aug 14 21:57:00 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:57:00 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:57:00 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:57:00 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:57:00 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:57:00 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:57:00 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:57:00 user nova-compute[73144]:       <nova:owner>
Aug 14 21:57:00 user nova-compute[73144]:         <nova:user uuid="f236788f6a93453b893ddf6d4cf01c1c">tempest-ServerActionsTestOtherA-202206255-project-member</nova:user>
Aug 14 21:57:00 user nova-compute[73144]:         <nova:project uuid="fe2005f37baf4b1b99effc98fddd0fdc">tempest-ServerActionsTestOtherA-202206255</nova:project>
Aug 14 21:57:00 user nova-compute[73144]:       </nova:owner>
Aug 14 21:57:00 user nova-compute[73144]:       <nova:ports>
Aug 14 21:57:00 user nova-compute[73144]:         <nova:port uuid="648e988b-1d10-4829-932b-88c863dc0cfa">
Aug 14 21:57:00 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 21:57:00 user nova-compute[73144]:         </nova:port>
Aug 14 21:57:00 user nova-compute[73144]:       </nova:ports>
Aug 14 21:57:00 user nova-compute[73144]:     </nova:instance>
Aug 14 21:57:00 user nova-compute[73144]:   </metadata>
Aug 14 21:57:00 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:57:00 user nova-compute[73144]:     <system>
Aug 14 21:57:00 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:57:00 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:57:00 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:57:00 user nova-compute[73144]:       <entry name="serial">37ba2c90-f471-4c24-ada2-084734722610</entry>
Aug 14 21:57:00 user nova-compute[73144]:       <entry name="uuid">37ba2c90-f471-4c24-ada2-084734722610</entry>
Aug 14 21:57:00 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:57:00 user nova-compute[73144]:     </system>
Aug 14 21:57:00 user nova-compute[73144]:   </sysinfo>
Aug 14 21:57:00 user nova-compute[73144]:   <os>
Aug 14 21:57:00 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:57:00 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:57:00 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:57:00 user nova-compute[73144]:   </os>
Aug 14 21:57:00 user nova-compute[73144]:   <features>
Aug 14 21:57:00 user nova-compute[73144]:     <acpi/>
Aug 14 21:57:00 user nova-compute[73144]:     <apic/>
Aug 14 21:57:00 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:57:00 user nova-compute[73144]:   </features>
Aug 14 21:57:00 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:57:00 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:57:00 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:57:00 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:57:00 user nova-compute[73144]:   </clock>
Aug 14 21:57:00 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:57:00 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:57:00 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:57:00 user nova-compute[73144]:   </cpu>
Aug 14 21:57:00 user nova-compute[73144]:   <devices>
Aug 14 21:57:00 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:57:00 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:57:00 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 21:57:00 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:57:00 user nova-compute[73144]:       <serial>582a8584-1c29-4bc1-ab9a-fac4705091d2</serial>
Aug 14 21:57:00 user nova-compute[73144]:     </disk>
Aug 14 21:57:00 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:57:00 user nova-compute[73144]:       <mac address="fa:16:3e:7d:81:4b"/>
Aug 14 21:57:00 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:00 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:57:00 user nova-compute[73144]:       <target dev="tap648e988b-1d"/>
Aug 14 21:57:00 user nova-compute[73144]:     </interface>
Aug 14 21:57:00 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:57:00 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/37ba2c90-f471-4c24-ada2-084734722610/console.log" append="off"/>
Aug 14 21:57:00 user nova-compute[73144]:     </serial>
Aug 14 21:57:00 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:57:00 user nova-compute[73144]:     <video>
Aug 14 21:57:00 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:00 user nova-compute[73144]:     </video>
Aug 14 21:57:00 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:57:00 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:57:00 user nova-compute[73144]:     </rng>
Aug 14 21:57:00 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:57:00 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:57:00 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:57:00 user nova-compute[73144]:     </memballoon>
Aug 14 21:57:00 user nova-compute[73144]:   </devices>
Aug 14 21:57:00 user nova-compute[73144]: </domain>
Aug 14 21:57:00 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-446237050',display_name='tempest-ServerActionsTestOtherA-server-446237050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-446237050',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-0tv7sgub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=37ba2c90-f471-4c24-ada2-084734722610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG os_vif [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap648e988b-1d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap648e988b-1d, col_values=(('external_ids', {'iface-id': '648e988b-1d10-4829-932b-88c863dc0cfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:81:4b', 'vm-uuid': '37ba2c90-f471-4c24-ada2-084734722610'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:01 user nova-compute[73144]: INFO os_vif [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d')
Aug 14 21:57:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No VIF found with MAC fa:16:3e:7d:81:4b, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-1db3eef7-1ad4-4f7a-b1bc-d19da6d1125d req-77316b16-2a62-4339-b70e-052d69cd60a4 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1db3eef7-1ad4-4f7a-b1bc-d19da6d1125d req-77316b16-2a62-4339-b70e-052d69cd60a4 service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1db3eef7-1ad4-4f7a-b1bc-d19da6d1125d req-77316b16-2a62-4339-b70e-052d69cd60a4 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1db3eef7-1ad4-4f7a-b1bc-d19da6d1125d req-77316b16-2a62-4339-b70e-052d69cd60a4 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-1db3eef7-1ad4-4f7a-b1bc-d19da6d1125d req-77316b16-2a62-4339-b70e-052d69cd60a4 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:02 user nova-compute[73144]: WARNING nova.compute.manager [req-1db3eef7-1ad4-4f7a-b1bc-d19da6d1125d req-77316b16-2a62-4339-b70e-052d69cd60a4 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received unexpected event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with vm_state building and task_state spawning.
Aug 14 21:57:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050224.4187284, 37ba2c90-f471-4c24-ada2-084734722610 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] VM Resumed (Lifecycle Event)
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:57:04 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance spawned successfully.
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050224.41982, 37ba2c90-f471-4c24-ada2-084734722610 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] VM Started (Lifecycle Event)
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:04 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:57:04 user nova-compute[73144]: INFO nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-455c4d4a-0e8c-4378-98b5-28a96dd0d93b req-042ff775-c36c-4922-bfbf-e88f0cc7c937 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-455c4d4a-0e8c-4378-98b5-28a96dd0d93b req-042ff775-c36c-4922-bfbf-e88f0cc7c937 service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-455c4d4a-0e8c-4378-98b5-28a96dd0d93b req-042ff775-c36c-4922-bfbf-e88f0cc7c937 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-455c4d4a-0e8c-4378-98b5-28a96dd0d93b req-042ff775-c36c-4922-bfbf-e88f0cc7c937 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-455c4d4a-0e8c-4378-98b5-28a96dd0d93b req-042ff775-c36c-4922-bfbf-e88f0cc7c937 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:04 user nova-compute[73144]: WARNING nova.compute.manager [req-455c4d4a-0e8c-4378-98b5-28a96dd0d93b req-042ff775-c36c-4922-bfbf-e88f0cc7c937 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received unexpected event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with vm_state building and task_state spawning.
Aug 14 21:57:04 user nova-compute[73144]: INFO nova.compute.manager [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Took 15.05 seconds to build instance.
Aug 14 21:57:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-60e1e410-6bb5-4799-b8c7-0aa7d8ea7ed6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.149s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:05 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:57:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-changed-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Refreshing instance network info cache due to event network-changed-53ee31ef-9655-4010-97f0-cbba5f46dd25. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] Acquiring lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] Acquired lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG nova.network.neutron [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Refreshing network info cache for port 53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:10 user nova-compute[73144]: INFO nova.compute.manager [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Rebuilding instance
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'pci_requests' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'pci_devices' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.network.neutron [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updated VIF entry in instance network info cache for port 53ee31ef-9655-4010-97f0-cbba5f46dd25. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.network.neutron [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updating instance_info_cache with network_info: [{"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'resources' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e32e619-c23c-4a18-9a67-570363136dc9 req-a5c194da-4520-40c6-a81f-0e18c0ed5e25 service nova] Releasing lock "refresh_cache-b5d5bf63-c36b-49d4-9b1a-3b0400da8316" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'migration_context' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73144) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-3be017be-8afd-49e7-913a-4cdbf393a08b req-bc937fee-c241-4ffe-8125-926909a84557 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-unplugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3be017be-8afd-49e7-913a-4cdbf393a08b req-bc937fee-c241-4ffe-8125-926909a84557 service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3be017be-8afd-49e7-913a-4cdbf393a08b req-bc937fee-c241-4ffe-8125-926909a84557 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3be017be-8afd-49e7-913a-4cdbf393a08b req-bc937fee-c241-4ffe-8125-926909a84557 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-3be017be-8afd-49e7-913a-4cdbf393a08b req-bc937fee-c241-4ffe-8125-926909a84557 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-unplugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:12 user nova-compute[73144]: WARNING nova.compute.manager [req-3be017be-8afd-49e7-913a-4cdbf393a08b req-bc937fee-c241-4ffe-8125-926909a84557 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received unexpected event network-vif-unplugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with vm_state active and task_state rebuilding.
Aug 14 21:57:12 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:57:12 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=25.227027893066406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:12 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance destroyed successfully.
Aug 14 21:57:12 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance destroyed successfully.
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-220476942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-261204191',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHZ/e53IiXo6wTwFCWP7MyIA/+2p/UAF9onpbLfhRdUpeTv4HK3RFYiXgJwZ6y8AcG53B74dTrxD9Wz7m4me6N5B1p7lg9g9vcR7+533T45GrcOu2F3MXDk2DK2Iu7Nw==',key_name='tempest-keypair-1594252963',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='120d1e9570db4175920fa929cceb5dca',ramdisk_id='',reservation_id='r-ll5f8vwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866803179',owner_user_name='tempest-ServerActionsV293TestJSON-1866803179-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:57:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb0f6e9d9c44114b6264802443c6e92',uuid=b5d5bf63-c36b-49d4-9b1a-3b0400da8316,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converting VIF {"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_vif [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ee31ef-96, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:57:12 user nova-compute[73144]: INFO os_vif [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96')
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:12 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0159ade2-4b04-4201-867b-9aee75bdb421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d444f411-fd2d-49da-9619-c0e62e98aec1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:12 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:12 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:12 user nova-compute[73144]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:12 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158491000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 89f447d4-22b3-42f7-8830-9facdce3412c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b5d5bf63-c36b-49d4-9b1a-3b0400da8316 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 91a32f0f-91a7-4724-ace4-8a333dee6878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 213eeac2-0579-4b7b-b08c-cb040cd54784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37ba2c90-f471-4c24-ada2-084734722610 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be81600-b0f9-4457-8932-b57924855c99]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b414ad7-466c-47bb-868b-e5e0989465bb]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d08bcb1-5ac2-4308-bb96-f3d0f7e78f1d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8ff2f3-bfbb-403a-9fce-16e20a1f0bb4]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5885774f-785c-4aed-9bbd-1bec6ebe95ab]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b491f1-ee44-4cec-bdd0-7bfef9426e06]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]
Aug 14 21:57:12 user nova-compute[73144]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.
Aug 14 21:57:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5d03a-6cfd-4472-837a-cf0f781116b7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] <== disconnect_volume: return (336ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:57:12 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Deleting instance files /opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316_del
Aug 14 21:57:12 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Deletion of /opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316_del complete
Aug 14 21:57:13 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:13 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b5d5bf63-c36b-49d4-9b1a-3b0400da8316 could not be found.
Aug 14 21:57:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:13 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed79b56a-a124-4cea-b652-8f02dd6d6f3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f4d4c0-cc87-437b-b370-f30c66e1a0d5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:13 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:13 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1585c5ab0>, {}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Disconnecting from: [] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] <== disconnect_volume: return (48ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:57:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-81d160f2-537b-4d88-a66f-c50e3064ca63 req-4db4faf2-832a-46bb-97c3-2ef2c77d5b5a service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81d160f2-537b-4d88-a66f-c50e3064ca63 req-4db4faf2-832a-46bb-97c3-2ef2c77d5b5a service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81d160f2-537b-4d88-a66f-c50e3064ca63 req-4db4faf2-832a-46bb-97c3-2ef2c77d5b5a service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-81d160f2-537b-4d88-a66f-c50e3064ca63 req-4db4faf2-832a-46bb-97c3-2ef2c77d5b5a service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-81d160f2-537b-4d88-a66f-c50e3064ca63 req-4db4faf2-832a-46bb-97c3-2ef2c77d5b5a service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:14 user nova-compute[73144]: WARNING nova.compute.manager [req-81d160f2-537b-4d88-a66f-c50e3064ca63 req-4db4faf2-832a-46bb-97c3-2ef2c77d5b5a service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received unexpected event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with vm_state active and task_state rebuilding.
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Preparing to wait for external event volume-reimaged-e06162af-f987-4cb8-aee8-7588733ce230 {{(pid=73144) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updating instance_info_cache with network_info: [{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:57:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:18 user nova-compute[73144]: INFO nova.compute.manager [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Unrescuing
Aug 14 21:57:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG nova.objects.instance [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'flavor' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-508df6bf-c3c8-4b57-b0f5-1fabc7d1ba33 req-0ffbb00c-1d63-4d9b-8fd6-a5e67290cde5 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-508df6bf-c3c8-4b57-b0f5-1fabc7d1ba33 req-0ffbb00c-1d63-4d9b-8fd6-a5e67290cde5 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-508df6bf-c3c8-4b57-b0f5-1fabc7d1ba33 req-0ffbb00c-1d63-4d9b-8fd6-a5e67290cde5 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-508df6bf-c3c8-4b57-b0f5-1fabc7d1ba33 req-0ffbb00c-1d63-4d9b-8fd6-a5e67290cde5 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-508df6bf-c3c8-4b57-b0f5-1fabc7d1ba33 req-0ffbb00c-1d63-4d9b-8fd6-a5e67290cde5 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:19 user nova-compute[73144]: WARNING nova.compute.manager [req-508df6bf-c3c8-4b57-b0f5-1fabc7d1ba33 req-0ffbb00c-1d63-4d9b-8fd6-a5e67290cde5 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:20 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance destroyed successfully.
Aug 14 21:57:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:21 user nova-compute[73144]: WARNING nova.compute.manager [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:21 user nova-compute[73144]: WARNING nova.compute.manager [req-1fa61383-29dc-4cad-86c0-7eeafa37c1ab req-209d13ac-8816-45d0-8709-e40f1b0de6fa service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for 9a143491-b86c-4768-9014-306bbeee8ad9 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050243.903569, 9a143491-b86c-4768-9014-306bbeee8ad9 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:23 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] VM Resumed (Lifecycle Event)
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-3faab992-6051-4399-b698-c305e0db5fc7 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-b571b667-fff8-4482-a2e6-45f0dd643dc5 req-6e0719b6-0c0b-4d42-9588-6a5d4792e5d3 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b571b667-fff8-4482-a2e6-45f0dd643dc5 req-6e0719b6-0c0b-4d42-9588-6a5d4792e5d3 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b571b667-fff8-4482-a2e6-45f0dd643dc5 req-6e0719b6-0c0b-4d42-9588-6a5d4792e5d3 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b571b667-fff8-4482-a2e6-45f0dd643dc5 req-6e0719b6-0c0b-4d42-9588-6a5d4792e5d3 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-b571b667-fff8-4482-a2e6-45f0dd643dc5 req-6e0719b6-0c0b-4d42-9588-6a5d4792e5d3 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:23 user nova-compute[73144]: WARNING nova.compute.manager [req-b571b667-fff8-4482-a2e6-45f0dd643dc5 req-6e0719b6-0c0b-4d42-9588-6a5d4792e5d3 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:23 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050243.9054892, 9a143491-b86c-4768-9014-306bbeee8ad9 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:23 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] VM Started (Lifecycle Event)
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:27 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050232.0510552, b5d5bf63-c36b-49d4-9b1a-3b0400da8316 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:27 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] VM Stopped (Lifecycle Event)
Aug 14 21:57:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c91cc14-ab11-4b9a-b392-35119fb8e2a7 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:29 user nova-compute[73144]: INFO nova.compute.manager [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] instance snapshotting
Aug 14 21:57:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Beginning live snapshot process
Aug 14 21:57:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpurvibovy/4a0478fbd40145aaa0d35a5a4b48c694.delta 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpurvibovy/4a0478fbd40145aaa0d35a5a4b48c694.delta 1073741824" returned: 0 in 0.051s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:30 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 21:57:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 21:57:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 21:57:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpurvibovy/4a0478fbd40145aaa0d35a5a4b48c694.delta /opt/stack/data/nova/instances/snapshots/tmpurvibovy/4a0478fbd40145aaa0d35a5a4b48c694 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpurvibovy/4a0478fbd40145aaa0d35a5a4b48c694.delta /opt/stack/data/nova/instances/snapshots/tmpurvibovy/4a0478fbd40145aaa0d35a5a4b48c694" returned: 0 in 0.290s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Snapshot extracted, beginning image upload
Aug 14 21:57:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-cde9969c-07ac-4820-818a-6b6eb3ead29c req-57f2ae49-73cc-4129-b22a-fd2877b9d8b0 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event volume-reimaged-e06162af-f987-4cb8-aee8-7588733ce230 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cde9969c-07ac-4820-818a-6b6eb3ead29c req-57f2ae49-73cc-4129-b22a-fd2877b9d8b0 service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cde9969c-07ac-4820-818a-6b6eb3ead29c req-57f2ae49-73cc-4129-b22a-fd2877b9d8b0 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cde9969c-07ac-4820-818a-6b6eb3ead29c req-57f2ae49-73cc-4129-b22a-fd2877b9d8b0 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-cde9969c-07ac-4820-818a-6b6eb3ead29c req-57f2ae49-73cc-4129-b22a-fd2877b9d8b0 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Processing event volume-reimaged-e06162af-f987-4cb8-aee8-7588733ce230 {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 14 21:57:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:57:32 user nova-compute[73144]: INFO nova.virt.block_device [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Booting with volume e06162af-f987-4cb8-aee8-7588733ce230 at /dev/vda
Aug 14 21:57:32 user nova-compute[73144]: DEBUG os_brick.utils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e026ca32-5542-4585-a1f3-c644bb2958ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0d86ea-ca76-4b8e-9cd1-2989c5a84160]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[23da2d46-32ad-4f9d-8ba2-96445494dd77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8441d-2e4d-4bb0-bd59-71abbacd7c25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:32 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:57:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce8228c-2f4b-496e-aa58-e413d16f155d]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG os_brick.utils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updating existing volume attachment record: 75fba581-0b6e-42e0-b6cc-c0bb44152ed3 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:57:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Snapshot image upload complete
Aug 14 21:57:34 user nova-compute[73144]: INFO nova.compute.manager [None req-705b4630-ff3a-4950-9f28-40522b1786ad tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Took 5.24 seconds to snapshot the instance on the hypervisor.
Aug 14 21:57:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:34 user nova-compute[73144]: INFO nova.compute.manager [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Unshelving
Aug 14 21:57:34 user nova-compute[73144]: INFO nova.virt.block_device [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Booting with volume cc871012-d411-41ef-b756-0c516e0b06e2 at /dev/vdc
Aug 14 21:57:35 user nova-compute[73144]: DEBUG os_brick.utils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6972266a-e18f-4de7-a2e9-c544c002f0d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd4d4a-4864-4039-847e-cc9cf07a45f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5b278c-87a1-4458-8274-dda04b55accc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07339e2-9c00-48a3-a38d-5e50f95f82bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:35 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:57:35 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[957f23f4-6451-4e3b-9681-56ddee8a2448]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG os_brick.utils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:35 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating existing volume attachment record: 1369bff1-853c-45c7-8972-0cd442470b49 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:57:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:57:37 user nova-compute[73144]: INFO nova.compute.claims [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Claim successful on node user
Aug 14 21:57:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:57:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:57:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG nova.policy [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b412578d976492cb05f9b674422687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94f10ae206741b9b6e08ef94ea04537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:57:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Creating image(s)
Aug 14 21:57:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "/opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "/opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "62d002efaff3e9feb01a6f38e0ae2fa3d792f21a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "62d002efaff3e9feb01a6f38e0ae2fa3d792f21a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Successfully created port: 83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG nova.virt.images [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] f54a4257-4614-4e11-af8d-9633325642ab was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.part /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.part /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.converted" returned: 0 in 0.462s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "62d002efaff3e9feb01a6f38e0ae2fa3d792f21a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.817s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "62d002efaff3e9feb01a6f38e0ae2fa3d792f21a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "62d002efaff3e9feb01a6f38e0ae2fa3d792f21a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Successfully updated port: 83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-changed-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Refreshing instance network info cache due to event network-changed-83d55052-b49e-4993-906e-5b18b5819e95. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] Acquiring lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] Acquired lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Refreshing network info cache for port 83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a --force-share --output=json" returned: 0 in 0.220s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a,backing_fmt=raw /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a,backing_fmt=raw /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk 1073741824" returned: 0 in 0.058s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "62d002efaff3e9feb01a6f38e0ae2fa3d792f21a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a --force-share --output=json" returned: 0 in 0.223s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'migration_context' on Instance uuid 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Ensure instance console log exists: /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-changed-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Refreshing instance network info cache due to event network-changed-b3e4c67b-c987-4848-830f-e644dd36f5a9. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] Acquiring lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] Acquired lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Refreshing network info cache for port b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94cccb85-aaff-4cbe-954c-7bdd9cb345de req-8f56103e-553b-4bfb-b66d-3a222de0cf21 service nova] Releasing lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquired lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:40 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updating instance_info_cache with network_info: [{"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Releasing lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Instance network_info: |[{"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Start _get_guest_xml network_info=[{"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='10ecaccd7f43ce6406b0d2f21521eb18',container_format='bare',created_at=2023-08-14T21:57:29Z,direct_url=<?>,disk_format='qcow2',id=f54a4257-4614-4e11-af8d-9633325642ab,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-261917358',owner='d94f10ae206741b9b6e08ef94ea04537',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T21:57:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'f54a4257-4614-4e11-af8d-9633325642ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:57:41 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:57:41 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='10ecaccd7f43ce6406b0d2f21521eb18',container_format='bare',created_at=2023-08-14T21:57:29Z,direct_url=<?>,disk_format='qcow2',id=f54a4257-4614-4e11-af8d-9633325642ab,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-261917358',owner='d94f10ae206741b9b6e08ef94ea04537',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T21:57:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-364220799',display_name='tempest-TestStampPattern-server-364220799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-364220799',id=32,image_ref='f54a4257-4614-4e11-af8d-9633325642ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo+Eu6fj6m04L/OHnRQniRF3Yy0E2Y3eNFOhLDS/TGnK4cUO2zCBraPB+7Labc3TI7bXn/UiCDNG8VquktTfLQx3I7Xh7zvPhR0fzTI8bJ9GlpyZ8Xst4GgNE/zOTx0nA==',key_name='tempest-TestStampPattern-973921468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d94f10ae206741b9b6e08ef94ea04537',ramdisk_id='',reservation_id='r-bjb92d96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4c8d3ab9-801b-41ba-ad20-2e202eccf0e7',image_min_disk='1',image_min_ram='0',image_owner_id='d94f10ae206741b9b6e08ef94ea04537',image_owner_project_name='tempest-TestStampPattern-2069970921',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2069970921-project-member',image_user_id='0b412578d976492cb05f9b674422687e',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069970921',owner_user_name='tempest-TestStampPattern-2069970921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:57:38Z,user_data=None,user_id='0b412578d976492cb05f9b674422687e',uuid=3ae0ac74-2cb4-4920-8ee5-58747b3214c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converting VIF {"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=83d55052-b49e-4993-906e-5b18b5819e95,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d55052-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:57:41 user nova-compute[73144]:   <uuid>3ae0ac74-2cb4-4920-8ee5-58747b3214c7</uuid>
Aug 14 21:57:41 user nova-compute[73144]:   <name>instance-00000020</name>
Aug 14 21:57:41 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:57:41 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:57:41 user nova-compute[73144]:   <metadata>
Aug 14 21:57:41 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:57:41 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:57:41 user nova-compute[73144]:       <nova:name>tempest-TestStampPattern-server-364220799</nova:name>
Aug 14 21:57:41 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:57:41</nova:creationTime>
Aug 14 21:57:41 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:57:41 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:57:41 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:57:41 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:57:41 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:57:41 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:57:41 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:57:41 user nova-compute[73144]:       <nova:owner>
Aug 14 21:57:41 user nova-compute[73144]:         <nova:user uuid="0b412578d976492cb05f9b674422687e">tempest-TestStampPattern-2069970921-project-member</nova:user>
Aug 14 21:57:41 user nova-compute[73144]:         <nova:project uuid="d94f10ae206741b9b6e08ef94ea04537">tempest-TestStampPattern-2069970921</nova:project>
Aug 14 21:57:41 user nova-compute[73144]:       </nova:owner>
Aug 14 21:57:41 user nova-compute[73144]:       <nova:root type="image" uuid="f54a4257-4614-4e11-af8d-9633325642ab"/>
Aug 14 21:57:41 user nova-compute[73144]:       <nova:ports>
Aug 14 21:57:41 user nova-compute[73144]:         <nova:port uuid="83d55052-b49e-4993-906e-5b18b5819e95">
Aug 14 21:57:41 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 21:57:41 user nova-compute[73144]:         </nova:port>
Aug 14 21:57:41 user nova-compute[73144]:       </nova:ports>
Aug 14 21:57:41 user nova-compute[73144]:     </nova:instance>
Aug 14 21:57:41 user nova-compute[73144]:   </metadata>
Aug 14 21:57:41 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:57:41 user nova-compute[73144]:     <system>
Aug 14 21:57:41 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:57:41 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:57:41 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:57:41 user nova-compute[73144]:       <entry name="serial">3ae0ac74-2cb4-4920-8ee5-58747b3214c7</entry>
Aug 14 21:57:41 user nova-compute[73144]:       <entry name="uuid">3ae0ac74-2cb4-4920-8ee5-58747b3214c7</entry>
Aug 14 21:57:41 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:57:41 user nova-compute[73144]:     </system>
Aug 14 21:57:41 user nova-compute[73144]:   </sysinfo>
Aug 14 21:57:41 user nova-compute[73144]:   <os>
Aug 14 21:57:41 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:57:41 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:57:41 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:57:41 user nova-compute[73144]:   </os>
Aug 14 21:57:41 user nova-compute[73144]:   <features>
Aug 14 21:57:41 user nova-compute[73144]:     <acpi/>
Aug 14 21:57:41 user nova-compute[73144]:     <apic/>
Aug 14 21:57:41 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:57:41 user nova-compute[73144]:   </features>
Aug 14 21:57:41 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:57:41 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:57:41 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:57:41 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:57:41 user nova-compute[73144]:   </clock>
Aug 14 21:57:41 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:57:41 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:57:41 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:57:41 user nova-compute[73144]:   </cpu>
Aug 14 21:57:41 user nova-compute[73144]:   <devices>
Aug 14 21:57:41 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:57:41 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:57:41 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk"/>
Aug 14 21:57:41 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:57:41 user nova-compute[73144]:     </disk>
Aug 14 21:57:41 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:57:41 user nova-compute[73144]:       <mac address="fa:16:3e:ca:44:4f"/>
Aug 14 21:57:41 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:41 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:57:41 user nova-compute[73144]:       <target dev="tap83d55052-b4"/>
Aug 14 21:57:41 user nova-compute[73144]:     </interface>
Aug 14 21:57:41 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:57:41 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/console.log" append="off"/>
Aug 14 21:57:41 user nova-compute[73144]:     </serial>
Aug 14 21:57:41 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:57:41 user nova-compute[73144]:     <video>
Aug 14 21:57:41 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:41 user nova-compute[73144]:     </video>
Aug 14 21:57:41 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:57:41 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:57:41 user nova-compute[73144]:     </rng>
Aug 14 21:57:41 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:57:41 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:57:41 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:57:41 user nova-compute[73144]:     </memballoon>
Aug 14 21:57:41 user nova-compute[73144]:   </devices>
Aug 14 21:57:41 user nova-compute[73144]: </domain>
Aug 14 21:57:41 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-364220799',display_name='tempest-TestStampPattern-server-364220799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-364220799',id=32,image_ref='f54a4257-4614-4e11-af8d-9633325642ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo+Eu6fj6m04L/OHnRQniRF3Yy0E2Y3eNFOhLDS/TGnK4cUO2zCBraPB+7Labc3TI7bXn/UiCDNG8VquktTfLQx3I7Xh7zvPhR0fzTI8bJ9GlpyZ8Xst4GgNE/zOTx0nA==',key_name='tempest-TestStampPattern-973921468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d94f10ae206741b9b6e08ef94ea04537',ramdisk_id='',reservation_id='r-bjb92d96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4c8d3ab9-801b-41ba-ad20-2e202eccf0e7',image_min_disk='1',image_min_ram='0',image_owner_id='d94f10ae206741b9b6e08ef94ea04537',image_owner_project_name='tempest-TestStampPattern-2069970921',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2069970921-project-member',image_user_id='0b412578d976492cb05f9b674422687e',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069970921',owner_user_name='tempest-TestStampPattern-2069970921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:57:38Z,user_data=None,user_id='0b412578d976492cb05f9b674422687e',uuid=3ae0ac74-2cb4-4920-8ee5-58747b3214c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converting VIF {"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=83d55052-b49e-4993-906e-5b18b5819e95,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d55052-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG os_vif [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=83d55052-b49e-4993-906e-5b18b5819e95,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d55052-b4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.neutron [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updated VIF entry in instance network info cache for port b3e4c67b-c987-4848-830f-e644dd36f5a9. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.network.neutron [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updating instance_info_cache with network_info: [{"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83d55052-b4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83d55052-b4, col_values=(('external_ids', {'iface-id': '83d55052-b49e-4993-906e-5b18b5819e95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:44:4f', 'vm-uuid': '3ae0ac74-2cb4-4920-8ee5-58747b3214c7'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:41 user nova-compute[73144]: INFO os_vif [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=83d55052-b49e-4993-906e-5b18b5819e95,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d55052-b4')
Aug 14 21:57:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b5b2842f-1913-4a77-8126-f1efe73409ab req-2c58dbb7-d003-40fe-adce-a7f4bc040702 service nova] Releasing lock "refresh_cache-91a32f0f-91a7-4724-ace4-8a333dee6878" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:57:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No VIF found with MAC fa:16:3e:ca:44:4f, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:57:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e79cb5d6-dac5-4eae-af63-b356eb3faacd req-c158ac4f-6cc6-43c7-9963-b781e00c7f1d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e79cb5d6-dac5-4eae-af63-b356eb3faacd req-c158ac4f-6cc6-43c7-9963-b781e00c7f1d service nova] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e79cb5d6-dac5-4eae-af63-b356eb3faacd req-c158ac4f-6cc6-43c7-9963-b781e00c7f1d service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e79cb5d6-dac5-4eae-af63-b356eb3faacd req-c158ac4f-6cc6-43c7-9963-b781e00c7f1d service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-e79cb5d6-dac5-4eae-af63-b356eb3faacd req-c158ac4f-6cc6-43c7-9963-b781e00c7f1d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] No waiting events found dispatching network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:43 user nova-compute[73144]: WARNING nova.compute.manager [req-e79cb5d6-dac5-4eae-af63-b356eb3faacd req-c158ac4f-6cc6-43c7-9963-b781e00c7f1d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received unexpected event network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 for instance with vm_state building and task_state spawning.
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:57:44 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Creating image(s)
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Ensure instance console log exists: /opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Start _get_guest_xml network_info=[{"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '75fba581-0b6e-42e0-b6cc-c0bb44152ed3', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5d5bf63-c36b-49d4-9b1a-3b0400da8316', 'attached_at': '', 'detached_at': '', 'volume_id': 'e06162af-f987-4cb8-aee8-7588733ce230', 'serial': 'e06162af-f987-4cb8-aee8-7588733ce230'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:57:44 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 21:57:44 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:44 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:44 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:44 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0f2075-f03d-4bf5-9160-e0f984f30d6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:57:44 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[449dfb45-560d-4317-820c-eb3fa43552bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230] added
Aug 14 21:57:44 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba4d3d7-c4b4-4e87-9ab7-59bbde72ab0d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94e7c40-c5b1-44c1-8acf-ac56753fa68c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuRWPyYr {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuRWPyYr" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef0d890-477c-4aad-b36c-c6e6cd21feba]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuRWPyYr'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[499411eb-1437-42cc-b361-3ffc2db5c933]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid 91a32f0f-91a7-4724-ace4-8a333dee6878 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a12a36-bfa0-46b6-9b65-77b19891c974]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-changed-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Refreshing instance network info cache due to event network-changed-70df378f-2f27-4b41-84e6-0f12ff4b0321. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] Acquiring lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] Acquired lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Refreshing network info cache for port 70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d50ba6c-e0ac-4f2f-ac2e-de2aa6565e98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]
Aug 14 21:57:44 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.
Aug 14 21:57:44 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[da55b95c-bd50-44ee-8323-360e11ced8c7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa77e8b-89bd-486f-a29e-0800da851f77]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:44 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f1cbb-3acd-4413-835b-9c9783d7b8a9]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:44 user nova-compute[73144]: INFO nova.compute.manager [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Attaching volume 88aa123a-e258-418d-9f09-4a7aa30658c0 to /dev/vdb
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.utils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170f103-f645-4f09-aedf-297fd8ce800c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a56dcfc-d06e-46d8-b25b-cffabe0b288c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88c027b-dd7c-464e-b75a-019c66e35d52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[48894aff-08c9-4a2b-bc8e-f8fede5a9102]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:45 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f198cc48-be8d-4ada-ae62-d26cbe267ae9]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.utils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updating existing volume attachment record: 684dfc05-ab28-4e06-a565-0bc841098222 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [req-63bd6413-85fe-422e-83b8-6f76918d9136 req-74d20eaf-8a8f-487a-acb3-4ee7284e3126 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-63bd6413-85fe-422e-83b8-6f76918d9136 req-74d20eaf-8a8f-487a-acb3-4ee7284e3126 service nova] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-63bd6413-85fe-422e-83b8-6f76918d9136 req-74d20eaf-8a8f-487a-acb3-4ee7284e3126 service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-63bd6413-85fe-422e-83b8-6f76918d9136 req-74d20eaf-8a8f-487a-acb3-4ee7284e3126 service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [req-63bd6413-85fe-422e-83b8-6f76918d9136 req-74d20eaf-8a8f-487a-acb3-4ee7284e3126 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] No waiting events found dispatching network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:45 user nova-compute[73144]: WARNING nova.compute.manager [req-63bd6413-85fe-422e-83b8-6f76918d9136 req-74d20eaf-8a8f-487a-acb3-4ee7284e3126 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received unexpected event network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 for instance with vm_state building and task_state spawning.
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050265.423404, 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] VM Resumed (Lifecycle Event)
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Instance spawned successfully.
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'pci_requests' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'numa_topology' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050265.425264, 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] VM Started (Lifecycle Event)
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.compute.claims [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Claim successful on node user
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Took 7.46 seconds to spawn the instance on the hypervisor.
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:57:45 user nova-compute[73144]: INFO nova.compute.manager [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Took 8.35 seconds to build instance.
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2fef3170-b201-4b95-80be-b30addc961a9 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.473s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.network.neutron [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updated VIF entry in instance network info cache for port 70df378f-2f27-4b41-84e6-0f12ff4b0321. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.network.neutron [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updating instance_info_cache with network_info: [{"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d51ef0d2-87ee-4865-a4f7-d800f2d01481 req-7826156c-9e5d-4d9e-aa17-aece3e93d295 service nova] Releasing lock "refresh_cache-213eeac2-0579-4b7b-b08c-cb040cd54784" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23265383365663363', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265383365663363', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-220476942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-261204191',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHZ/e53IiXo6wTwFCWP7MyIA/+2p/UAF9onpbLfhRdUpeTv4HK3RFYiXgJwZ6y8AcG53B74dTrxD9Wz7m4me6N5B1p7lg9g9vcR7+533T45GrcOu2F3MXDk2DK2Iu7Nw==',key_name='tempest-keypair-1594252963',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='120d1e9570db4175920fa929cceb5dca',ramdisk_id='',reservation_id='r-ll5f8vwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866803179',owner_user_name='tempest-ServerActionsV293TestJSON-1866803179-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb0f6e9d9c44114b6264802443c6e92',uuid=b5d5bf63-c36b-49d4-9b1a-3b0400da8316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converting VIF {"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:57:45 user nova-compute[73144]:   <uuid>b5d5bf63-c36b-49d4-9b1a-3b0400da8316</uuid>
Aug 14 21:57:45 user nova-compute[73144]:   <name>instance-0000001c</name>
Aug 14 21:57:45 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:57:45 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:57:45 user nova-compute[73144]:   <metadata>
Aug 14 21:57:45 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:57:45 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:57:45 user nova-compute[73144]:       <nova:name>tempest-ServerActionsV293TestJSON-server-220476942</nova:name>
Aug 14 21:57:45 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:57:44</nova:creationTime>
Aug 14 21:57:45 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:57:45 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:57:45 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:57:45 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:57:45 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:57:45 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:57:45 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:57:45 user nova-compute[73144]:       <nova:owner>
Aug 14 21:57:45 user nova-compute[73144]:         <nova:user uuid="fbb0f6e9d9c44114b6264802443c6e92">tempest-ServerActionsV293TestJSON-1866803179-project-member</nova:user>
Aug 14 21:57:45 user nova-compute[73144]:         <nova:project uuid="120d1e9570db4175920fa929cceb5dca">tempest-ServerActionsV293TestJSON-1866803179</nova:project>
Aug 14 21:57:45 user nova-compute[73144]:       </nova:owner>
Aug 14 21:57:45 user nova-compute[73144]:       <nova:ports>
Aug 14 21:57:45 user nova-compute[73144]:         <nova:port uuid="53ee31ef-9655-4010-97f0-cbba5f46dd25">
Aug 14 21:57:45 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 21:57:45 user nova-compute[73144]:         </nova:port>
Aug 14 21:57:45 user nova-compute[73144]:       </nova:ports>
Aug 14 21:57:45 user nova-compute[73144]:     </nova:instance>
Aug 14 21:57:45 user nova-compute[73144]:   </metadata>
Aug 14 21:57:45 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:57:45 user nova-compute[73144]:     <system>
Aug 14 21:57:45 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:57:45 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:57:45 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:57:45 user nova-compute[73144]:       <entry name="serial">b5d5bf63-c36b-49d4-9b1a-3b0400da8316</entry>
Aug 14 21:57:45 user nova-compute[73144]:       <entry name="uuid">b5d5bf63-c36b-49d4-9b1a-3b0400da8316</entry>
Aug 14 21:57:45 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:57:45 user nova-compute[73144]:     </system>
Aug 14 21:57:45 user nova-compute[73144]:   </sysinfo>
Aug 14 21:57:45 user nova-compute[73144]:   <os>
Aug 14 21:57:45 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:57:45 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:57:45 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:57:45 user nova-compute[73144]:   </os>
Aug 14 21:57:45 user nova-compute[73144]:   <features>
Aug 14 21:57:45 user nova-compute[73144]:     <acpi/>
Aug 14 21:57:45 user nova-compute[73144]:     <apic/>
Aug 14 21:57:45 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:57:45 user nova-compute[73144]:   </features>
Aug 14 21:57:45 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:57:45 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:57:45 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:57:45 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:57:45 user nova-compute[73144]:   </clock>
Aug 14 21:57:45 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:57:45 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:57:45 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:57:45 user nova-compute[73144]:   </cpu>
Aug 14 21:57:45 user nova-compute[73144]:   <devices>
Aug 14 21:57:45 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:57:45 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:57:45 user nova-compute[73144]:       <source dev="/dev/sdd"/>
Aug 14 21:57:45 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:57:45 user nova-compute[73144]:       <serial>e06162af-f987-4cb8-aee8-7588733ce230</serial>
Aug 14 21:57:45 user nova-compute[73144]:     </disk>
Aug 14 21:57:45 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:57:45 user nova-compute[73144]:       <mac address="fa:16:3e:6d:27:42"/>
Aug 14 21:57:45 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:45 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:57:45 user nova-compute[73144]:       <target dev="tap53ee31ef-96"/>
Aug 14 21:57:45 user nova-compute[73144]:     </interface>
Aug 14 21:57:45 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:57:45 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316/console.log" append="off"/>
Aug 14 21:57:45 user nova-compute[73144]:     </serial>
Aug 14 21:57:45 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:57:45 user nova-compute[73144]:     <video>
Aug 14 21:57:45 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:45 user nova-compute[73144]:     </video>
Aug 14 21:57:45 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:57:45 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:57:45 user nova-compute[73144]:     </rng>
Aug 14 21:57:45 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:57:45 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:57:45 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:57:45 user nova-compute[73144]:     </memballoon>
Aug 14 21:57:45 user nova-compute[73144]:   </devices>
Aug 14 21:57:45 user nova-compute[73144]: </domain>
Aug 14 21:57:45 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-220476942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-261204191',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHZ/e53IiXo6wTwFCWP7MyIA/+2p/UAF9onpbLfhRdUpeTv4HK3RFYiXgJwZ6y8AcG53B74dTrxD9Wz7m4me6N5B1p7lg9g9vcR7+533T45GrcOu2F3MXDk2DK2Iu7Nw==',key_name='tempest-keypair-1594252963',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='120d1e9570db4175920fa929cceb5dca',ramdisk_id='',reservation_id='r-ll5f8vwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866803179',owner_user_name='tempest-ServerActionsV293TestJSON-1866803179-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb0f6e9d9c44114b6264802443c6e92',uuid=b5d5bf63-c36b-49d4-9b1a-3b0400da8316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converting VIF {"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG os_vif [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ee31ef-96, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53ee31ef-96, col_values=(('external_ids', {'iface-id': '53ee31ef-9655-4010-97f0-cbba5f46dd25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:27:42', 'vm-uuid': 'b5d5bf63-c36b-49d4-9b1a-3b0400da8316'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:57:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:45 user nova-compute[73144]: INFO os_vif [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96')
Aug 14 21:57:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:57:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] No VIF found with MAC fa:16:3e:6d:27:42, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:57:46 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:57:46 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:57:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:46 user nova-compute[73144]: INFO nova.network.neutron [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating port f39a4a57-be14-4d33-b6d0-f6e8469b9d55 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 21:57:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquired lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing instance network info cache due to event network-changed-f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] Acquiring lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-6efde5e1-176c-4fcb-b118-905820586ea6 req-045648bd-a4f4-4057-8590-f93232a7b22e service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6efde5e1-176c-4fcb-b118-905820586ea6 req-045648bd-a4f4-4057-8590-f93232a7b22e service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6efde5e1-176c-4fcb-b118-905820586ea6 req-045648bd-a4f4-4057-8590-f93232a7b22e service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6efde5e1-176c-4fcb-b118-905820586ea6 req-045648bd-a4f4-4057-8590-f93232a7b22e service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-6efde5e1-176c-4fcb-b118-905820586ea6 req-045648bd-a4f4-4057-8590-f93232a7b22e service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:47 user nova-compute[73144]: WARNING nova.compute.manager [req-6efde5e1-176c-4fcb-b118-905820586ea6 req-045648bd-a4f4-4057-8590-f93232a7b22e service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received unexpected event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 21:57:47 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:47 user nova-compute[73144]: INFO nova.compute.manager [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Unrescuing
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:57:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Releasing lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:57:48 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Creating image(s)
Aug 14 21:57:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'trusted_certs' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] Acquired lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG nova.network.neutron [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Refreshing network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "b9bbb1d261c8f41a2357736d5eb223d7399856ad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "b9bbb1d261c8f41a2357736d5eb223d7399856ad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.part --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG nova.virt.images [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] 7db968ee-b1c3-4b7f-ad14-03c43bca0012 was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.part /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.part /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.converted" returned: 0 in 0.385s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-f15a1482-e631-4eca-aa19-ec0a60a68fef req-e896de22-9266-4cb1-9f4f-d4e2a1f05120 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f15a1482-e631-4eca-aa19-ec0a60a68fef req-e896de22-9266-4cb1-9f4f-d4e2a1f05120 service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f15a1482-e631-4eca-aa19-ec0a60a68fef req-e896de22-9266-4cb1-9f4f-d4e2a1f05120 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f15a1482-e631-4eca-aa19-ec0a60a68fef req-e896de22-9266-4cb1-9f4f-d4e2a1f05120 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-f15a1482-e631-4eca-aa19-ec0a60a68fef req-e896de22-9266-4cb1-9f4f-d4e2a1f05120 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:50 user nova-compute[73144]: WARNING nova.compute.manager [req-f15a1482-e631-4eca-aa19-ec0a60a68fef req-e896de22-9266-4cb1-9f4f-d4e2a1f05120 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received unexpected event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updated VIF entry in instance network info cache for port f39a4a57-be14-4d33-b6d0-f6e8469b9d55. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8a4f5bdd-63dd-40fc-8279-3ca41e8ed7c3 req-5905f840-b5d4-4998-92c3-7aa1de2fb171 service nova] Releasing lock "refresh_cache-db61b783-50d7-4304-a031-f9fb11069ef1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "b9bbb1d261c8f41a2357736d5eb223d7399856ad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.151s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'flavor' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:50 user nova-compute[73144]: INFO nova.compute.manager [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Attaching volume 2f65d454-b42c-4c29-8a9d-dd55db7aac4f to /dev/vdb
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050270.3804047, b5d5bf63-c36b-49d4-9b1a-3b0400da8316 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:50 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] VM Resumed (Lifecycle Event)
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad --force-share --output=json" returned: 0 in 0.265s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "b9bbb1d261c8f41a2357736d5eb223d7399856ad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "b9bbb1d261c8f41a2357736d5eb223d7399856ad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance spawned successfully.
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG os_brick.utils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:50 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050270.3816342, b5d5bf63-c36b-49d4-9b1a-3b0400da8316 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:50 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] VM Started (Lifecycle Event)
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f41a4-d920-4688-bbfb-d4c966fd95ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68ebcdb-b571-4869-bb3d-31662035e94c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb54596-bbc3-4011-a252-f5103b837ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8110b19-6708-47ee-93db-b114117bee32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:57:50 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad --force-share --output=json" returned: 0 in 0.275s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad,backing_fmt=raw /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:57:50 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64c1408-32fe-4935-823d-659c220c3ef0]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG os_brick.utils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== get_connector_properties: return (256ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updating existing volume attachment record: 18635305-f531-4f26-88e6-18b75a70c91d {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-04242b7d-c7c8-407a-b70e-5d3ce5ffa960 req-22403c7f-0b5a-44eb-933c-9815ff276491 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-04242b7d-c7c8-407a-b70e-5d3ce5ffa960 req-22403c7f-0b5a-44eb-933c-9815ff276491 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-04242b7d-c7c8-407a-b70e-5d3ce5ffa960 req-22403c7f-0b5a-44eb-933c-9815ff276491 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-04242b7d-c7c8-407a-b70e-5d3ce5ffa960 req-22403c7f-0b5a-44eb-933c-9815ff276491 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-04242b7d-c7c8-407a-b70e-5d3ce5ffa960 req-22403c7f-0b5a-44eb-933c-9815ff276491 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:50 user nova-compute[73144]: WARNING nova.compute.manager [req-04242b7d-c7c8-407a-b70e-5d3ce5ffa960 req-22403c7f-0b5a-44eb-933c-9815ff276491 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad,backing_fmt=raw /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk 1073741824" returned: 0 in 0.089s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "b9bbb1d261c8f41a2357736d5eb223d7399856ad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73144) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 21:57:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance destroyed successfully.
Aug 14 21:57:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad --force-share --output=json" returned: 0 in 0.342s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'migration_context' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Rebasing disk image.
Aug 14 21:57:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cde9969c-07ac-4820-818a-6b6eb3ead29c tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.227s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.240s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 -F raw /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-4e87ca22-3ba7-483f-9041-2ded159d3cd3 req-858c87c9-9991-4f87-8c86-f03ec9caf114 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e87ca22-3ba7-483f-9041-2ded159d3cd3 req-858c87c9-9991-4f87-8c86-f03ec9caf114 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e87ca22-3ba7-483f-9041-2ded159d3cd3 req-858c87c9-9991-4f87-8c86-f03ec9caf114 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4e87ca22-3ba7-483f-9041-2ded159d3cd3 req-858c87c9-9991-4f87-8c86-f03ec9caf114 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-4e87ca22-3ba7-483f-9041-2ded159d3cd3 req-858c87c9-9991-4f87-8c86-f03ec9caf114 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:52 user nova-compute[73144]: WARNING nova.compute.manager [req-4e87ca22-3ba7-483f-9041-2ded159d3cd3 req-858c87c9-9991-4f87-8c86-f03ec9caf114 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 -F raw /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk" returned: 0 in 3.292s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Ensure instance console log exists: /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Start _get_guest_xml network_info=[{"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3ebf79127afc7518f0c4d4e1d77f1801',container_format='bare',created_at=2023-08-14T21:55:42Z,direct_url=<?>,disk_format='qcow2',id=7db968ee-b1c3-4b7f-ad14-03c43bca0012,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1737547142-shelved',owner='69745a6a4d3345fcb143da4f825a2100',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T21:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '1369bff1-853c-45c7-8972-0cd442470b49', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrsMqOtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'db61b783-50d7-4304-a031-f9fb11069ef1', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc871012-d411-41ef-b756-0c516e0b06e2', 'serial': 'cc871012-d411-41ef-b756-0c516e0b06e2'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:57:54 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:57:54 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3ebf79127afc7518f0c4d4e1d77f1801',container_format='bare',created_at=2023-08-14T21:55:42Z,direct_url=<?>,disk_format='qcow2',id=7db968ee-b1c3-4b7f-ad14-03c43bca0012,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1737547142-shelved',owner='69745a6a4d3345fcb143da4f825a2100',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T21:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'vcpu_model' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrsMqOtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:54 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:54 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:54 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[df23ece5-f668-44e7-b197-b1a33d790759]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:57:54 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[508becde-03cc-40dd-95a3-a0f61d5272f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2] added
Aug 14 21:57:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5182cc-2390-4bf5-972c-fcf8769be817]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[387e17bc-27c7-43c5-a0dc-98a3925d1840]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VrsMqOtI {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:55 user nova-compute[73144]: WARNING nova.compute.manager [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:55 user nova-compute[73144]: WARNING nova.compute.manager [req-5b624cd9-a2ac-426f-842e-290634641425 req-0e146cc0-6be2-44b0-9fae-7f7070f6401c service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state rescued and task_state unrescuing.
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VrsMqOtI" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55f83f3-2997-41a9-a284-338527216fc2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VrsMqOtI'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6038a30d-c134-4bbc-9434-34e8ae5f68ca]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fec419c-3f5b-4f51-8c35-e37d0d537e74]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f862dd-05a7-4d4e-8e6f-6e010ab84081]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260]
Aug 14 21:57:55 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260] successful.
Aug 14 21:57:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3c522f-5c92-4dfe-b120-04f57a4ce5e3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07efe37-a2b9-4362-a4cf-440be3e8e3a0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:57:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[34687b0f-785f-441f-bcc2-615040bf1ba8]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrsMqOtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for 5229a303-2dad-45a6-b140-29a55d8d29a7 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050275.9753115, 5229a303-2dad-45a6-b140-29a55d8d29a7 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:55 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] VM Resumed (Lifecycle Event)
Aug 14 21:57:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b97df744-d976-459b-968a-4b4dd9d0a925 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:56 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050275.9806612, 5229a303-2dad-45a6-b140-29a55d8d29a7 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:57:56 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] VM Started (Lifecycle Event)
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26337623232353939', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337623232353939', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1737547142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1737547142',id=24,image_ref='7db968ee-b1c3-4b7f-ad14-03c43bca0012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1826093270',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-gir6zm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member',shelved_at='2023-08-14T21:55:46.333982',shelved_host='user',shelved_image_id='7db968ee-b1c3-4b7f-ad14-03c43bca0012'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=db61b783-50d7-4304-a031-f9fb11069ef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'pci_devices' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:57:56 user nova-compute[73144]:   <uuid>db61b783-50d7-4304-a031-f9fb11069ef1</uuid>
Aug 14 21:57:56 user nova-compute[73144]:   <name>instance-00000018</name>
Aug 14 21:57:56 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:57:56 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:57:56 user nova-compute[73144]:   <metadata>
Aug 14 21:57:56 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:57:56 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:57:56 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1737547142</nova:name>
Aug 14 21:57:56 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:57:54</nova:creationTime>
Aug 14 21:57:56 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:57:56 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:57:56 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:57:56 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:57:56 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:57:56 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:57:56 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:57:56 user nova-compute[73144]:       <nova:owner>
Aug 14 21:57:56 user nova-compute[73144]:         <nova:user uuid="11172444b2d54c0dae51f822168f586a">tempest-AttachVolumeShelveTestJSON-1156240232-project-member</nova:user>
Aug 14 21:57:56 user nova-compute[73144]:         <nova:project uuid="69745a6a4d3345fcb143da4f825a2100">tempest-AttachVolumeShelveTestJSON-1156240232</nova:project>
Aug 14 21:57:56 user nova-compute[73144]:       </nova:owner>
Aug 14 21:57:56 user nova-compute[73144]:       <nova:root type="image" uuid="7db968ee-b1c3-4b7f-ad14-03c43bca0012"/>
Aug 14 21:57:56 user nova-compute[73144]:       <nova:ports>
Aug 14 21:57:56 user nova-compute[73144]:         <nova:port uuid="f39a4a57-be14-4d33-b6d0-f6e8469b9d55">
Aug 14 21:57:56 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 21:57:56 user nova-compute[73144]:         </nova:port>
Aug 14 21:57:56 user nova-compute[73144]:       </nova:ports>
Aug 14 21:57:56 user nova-compute[73144]:     </nova:instance>
Aug 14 21:57:56 user nova-compute[73144]:   </metadata>
Aug 14 21:57:56 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:57:56 user nova-compute[73144]:     <system>
Aug 14 21:57:56 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:57:56 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:57:56 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:57:56 user nova-compute[73144]:       <entry name="serial">db61b783-50d7-4304-a031-f9fb11069ef1</entry>
Aug 14 21:57:56 user nova-compute[73144]:       <entry name="uuid">db61b783-50d7-4304-a031-f9fb11069ef1</entry>
Aug 14 21:57:56 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:57:56 user nova-compute[73144]:     </system>
Aug 14 21:57:56 user nova-compute[73144]:   </sysinfo>
Aug 14 21:57:56 user nova-compute[73144]:   <os>
Aug 14 21:57:56 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:57:56 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:57:56 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:57:56 user nova-compute[73144]:   </os>
Aug 14 21:57:56 user nova-compute[73144]:   <features>
Aug 14 21:57:56 user nova-compute[73144]:     <acpi/>
Aug 14 21:57:56 user nova-compute[73144]:     <apic/>
Aug 14 21:57:56 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:57:56 user nova-compute[73144]:   </features>
Aug 14 21:57:56 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:57:56 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:57:56 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:57:56 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:57:56 user nova-compute[73144]:   </clock>
Aug 14 21:57:56 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:57:56 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:57:56 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:57:56 user nova-compute[73144]:   </cpu>
Aug 14 21:57:56 user nova-compute[73144]:   <devices>
Aug 14 21:57:56 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:57:56 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:57:56 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk"/>
Aug 14 21:57:56 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:57:56 user nova-compute[73144]:     </disk>
Aug 14 21:57:56 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:57:56 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:57:56 user nova-compute[73144]:       <source dev="/dev/sde"/>
Aug 14 21:57:56 user nova-compute[73144]:       <target dev="vdc" bus="virtio"/>
Aug 14 21:57:56 user nova-compute[73144]:       <serial>cc871012-d411-41ef-b756-0c516e0b06e2</serial>
Aug 14 21:57:56 user nova-compute[73144]:     </disk>
Aug 14 21:57:56 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:57:56 user nova-compute[73144]:       <mac address="fa:16:3e:93:8d:d6"/>
Aug 14 21:57:56 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:56 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:57:56 user nova-compute[73144]:       <target dev="tapf39a4a57-be"/>
Aug 14 21:57:56 user nova-compute[73144]:     </interface>
Aug 14 21:57:56 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:57:56 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/console.log" append="off"/>
Aug 14 21:57:56 user nova-compute[73144]:     </serial>
Aug 14 21:57:56 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:57:56 user nova-compute[73144]:     <video>
Aug 14 21:57:56 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:57:56 user nova-compute[73144]:     </video>
Aug 14 21:57:56 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:57:56 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:57:56 user nova-compute[73144]:     </rng>
Aug 14 21:57:56 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:57:56 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:57:56 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:57:56 user nova-compute[73144]:     </memballoon>
Aug 14 21:57:56 user nova-compute[73144]:   </devices>
Aug 14 21:57:56 user nova-compute[73144]: </domain>
Aug 14 21:57:56 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1737547142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1737547142',id=24,image_ref='7db968ee-b1c3-4b7f-ad14-03c43bca0012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1826093270',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-gir6zm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member',shelved_at='2023-08-14T21:55:46.333982',shelved_host='user',shelved_image_id='7db968ee-b1c3-4b7f-ad14-03c43bca0012'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=db61b783-50d7-4304-a031-f9fb11069ef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG os_vif [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf39a4a57-be, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf39a4a57-be, col_values=(('external_ids', {'iface-id': 'f39a4a57-be14-4d33-b6d0-f6e8469b9d55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:8d:d6', 'vm-uuid': 'db61b783-50d7-4304-a031-f9fb11069ef1'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:56 user nova-compute[73144]: INFO os_vif [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be')
Aug 14 21:57:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:57:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No VIF found with MAC fa:16:3e:93:8d:d6, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHvCZqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:57:57 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:57 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:57:57 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38dccdd-921a-436d-8d3e-cd8047697bb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:57:57 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e15e9b1-c636-4ab9-8abd-05f1c2574b1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0] added
Aug 14 21:57:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9471fc-a31a-424e-bbf1-2d19a182616c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6567f2d1-2853-48ab-8c6a-ec5bde31b2bf]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERHvCZqL {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERHvCZqL" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8be96f-7752-4990-9846-93b518dd6382]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERHvCZqL'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e42706-6fb8-466d-a7c8-e79a11050d7b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd7eea9-ab06-458b-af42-151654e62cf4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b884a-53b8-466a-a9a8-a31ba38604e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260]
Aug 14 21:57:57 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260] successful.
Aug 14 21:57:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b701bc-d96e-46cf-a20e-909c25953926]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff3cc5-167e-445c-bfe3-ca3d15e4cb31]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 (non-flash)
Aug 14 21:57:57 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[db84027e-4060-471d-aa0f-efb626cbdf97]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:57:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHvCZqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-62c968b8-36fb-4326-8a7e-5a864dd3de18 req-1ecfc6d6-3e15-496c-bcd2-c5d39d54a151 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-62c968b8-36fb-4326-8a7e-5a864dd3de18 req-1ecfc6d6-3e15-496c-bcd2-c5d39d54a151 service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-62c968b8-36fb-4326-8a7e-5a864dd3de18 req-1ecfc6d6-3e15-496c-bcd2-c5d39d54a151 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-62c968b8-36fb-4326-8a7e-5a864dd3de18 req-1ecfc6d6-3e15-496c-bcd2-c5d39d54a151 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-62c968b8-36fb-4326-8a7e-5a864dd3de18 req-1ecfc6d6-3e15-496c-bcd2-c5d39d54a151 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:57:58 user nova-compute[73144]: WARNING nova.compute.manager [req-62c968b8-36fb-4326-8a7e-5a864dd3de18 req-1ecfc6d6-3e15-496c-bcd2-c5d39d54a151 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received unexpected event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 21:57:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26337336166313933', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337336166313933', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:57:58 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid 91a32f0f-91a7-4724-ace4-8a333dee6878 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:57:59 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:57:59 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:57:59 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:57:59 user nova-compute[73144]:   <serial>88aa123a-e258-418d-9f09-4a7aa30658c0</serial>
Aug 14 21:57:59 user nova-compute[73144]: </disk>
Aug 14 21:57:59 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] No VIF found with MAC fa:16:3e:2c:28:9f, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:57:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b87b4aac-1d46-43c1-96a9-df423865a7fb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.735s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:00 user nova-compute[73144]: INFO nova.compute.manager [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Detaching volume 88aa123a-e258-418d-9f09-4a7aa30658c0
Aug 14 21:58:00 user nova-compute[73144]: INFO nova.virt.block_device [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Attempting to driver detach volume 88aa123a-e258-418d-9f09-4a7aa30658c0 from mountpoint /dev/vdb
Aug 14 21:58:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-54629fdf-a39c-43b0-b8f0-e758ca461c1b req-ab5aff52-fdf4-44d9-8f3a-62879464022a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-54629fdf-a39c-43b0-b8f0-e758ca461c1b req-ab5aff52-fdf4-44d9-8f3a-62879464022a service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-54629fdf-a39c-43b0-b8f0-e758ca461c1b req-ab5aff52-fdf4-44d9-8f3a-62879464022a service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-54629fdf-a39c-43b0-b8f0-e758ca461c1b req-ab5aff52-fdf4-44d9-8f3a-62879464022a service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-54629fdf-a39c-43b0-b8f0-e758ca461c1b req-ab5aff52-fdf4-44d9-8f3a-62879464022a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:00 user nova-compute[73144]: WARNING nova.compute.manager [req-54629fdf-a39c-43b0-b8f0-e758ca461c1b req-ab5aff52-fdf4-44d9-8f3a-62879464022a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received unexpected event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 21:58:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Attempting to detach device vdb from instance 91a32f0f-91a7-4724-ace4-8a333dee6878 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:58:00 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:00 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:58:00 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:58:00 user nova-compute[73144]:   <serial>88aa123a-e258-418d-9f09-4a7aa30658c0</serial>
Aug 14 21:58:00 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:58:00 user nova-compute[73144]: </disk>
Aug 14 21:58:00 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:58:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully detached device vdb from instance 91a32f0f-91a7-4724-ace4-8a333dee6878 from the persistent domain config.
Aug 14 21:58:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91a32f0f-91a7-4724-ace4-8a333dee6878 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:58:00 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:00 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:58:00 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:58:00 user nova-compute[73144]:   <serial>88aa123a-e258-418d-9f09-4a7aa30658c0</serial>
Aug 14 21:58:00 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:58:00 user nova-compute[73144]: </disk>
Aug 14 21:58:00 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:58:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050280.9989843, 91a32f0f-91a7-4724-ace4-8a333dee6878 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91a32f0f-91a7-4724-ace4-8a333dee6878 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:58:01 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully detached device vdb from instance 91a32f0f-91a7-4724-ace4-8a333dee6878 from the live domain config.
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHvCZqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:01 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1289e0-bd9e-4d64-819b-8ad5a70d9842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050281.0515964, db61b783-50d7-4304-a031-f9fb11069ef1 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:58:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] VM Resumed (Lifecycle Event)
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance spawned successfully.
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fac8bff-dd63-4984-b84d-c1e3f761fbb1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 (non-flash)
Aug 14 21:58:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa178508820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0'): ({'sdf'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Removing single pathed devices sdf {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:58:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050281.0530636, db61b783-50d7-4304-a031-f9fb11069ef1 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:58:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] VM Started (Lifecycle Event)
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec7926-28b7-4b41-95c1-98ee6d533884]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6c7c3-aaf9-4783-ac94-2603a72facf5]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Flushing IO for device /dev/sdf {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd057afc-d93e-4d3e-992f-1ff0d1919b13]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:58:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[016b7995-6b3b-4a69-9fde-516ee1998ec5]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1434c5c-a3f6-4bdb-8f84-53314f355a96]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a7deb-574a-48af-b923-1defabe6555d]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260]
Aug 14 21:58:01 user nova-compute[73144]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0, portal: 172.16.0.220,3260] successful.
Aug 14 21:58:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88aa123a-e258-418d-9f09-4a7aa30658c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446b4c8-a29a-4126-b772-4ef90fe000f1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] <== disconnect_volume: return (416ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb88-90e3-46f1-8505-e64042958701 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.755s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otFTpJhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:01 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:01 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:01 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c824d9b-e5e3-4e5a-9859-1b5a91652757]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:58:01 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a39976-af89-4cce-82e7-5c7ab7c27c32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f] added
Aug 14 21:58:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf490a3-eb67-41fd-9515-5e707b5e46ba]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[84200874-3725-49db-bb30-d8fb29b5411a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v otFTpJhR {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v otFTpJhR" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d38fa45-67ff-4981-8e06-272ca1e12c7b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'otFTpJhR'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd506841-5b65-4d86-bd14-23cea114bb8c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2477cf8c-880a-4e53-9705-0147dfbfcbf0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --login" returned: 0 in 0.147s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bacce4-154e-4a8a-911a-e22cb1f542a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260]
Aug 14 21:58:02 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260] successful.
Aug 14 21:58:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc3d5f6-be90-44ee-9ea1-e60ae9221dfb]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bbbb91-f9c9-462f-ae2d-e2efaaff8dc9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:02 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:02 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd39583-0b05-4694-8e01-36a6c97e2e7a]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otFTpJhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'flavor' on Instance uuid 91a32f0f-91a7-4724-ace4-8a333dee6878 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-de0b82f7-1807-49a2-829f-51741ba4df5a tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.045s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23333353733346164', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333353733346164', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:58:03 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:03 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:58:03 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:58:03 user nova-compute[73144]:   <serial>2f65d454-b42c-4c29-8a9d-dd55db7aac4f</serial>
Aug 14 21:58:03 user nova-compute[73144]: </disk>
Aug 14 21:58:03 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:58:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No VIF found with MAC fa:16:3e:6b:9a:63, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:58:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cd3718b6-d91a-40c7-9375-82185e533fe6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.705s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:58:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG nova.objects.instance [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:09 user nova-compute[73144]: INFO nova.compute.manager [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Attaching volume 6e5ba33f-6d57-48dd-99a8-1385896658de to /dev/vdc
Aug 14 21:58:10 user nova-compute[73144]: DEBUG os_brick.utils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3db857-552a-4170-ba16-a20920331fb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ea9d58-51b6-4418-9843-f72fb7eb3ca7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d028e378-facb-4f1a-b601-eb91e3f69bc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f403bb71-c4c5-4945-880b-f433a5a0620e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:58:10 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf46a48-45ed-4480-b148-30649e6757ed]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG os_brick.utils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updating existing volume attachment record: 8ca0b4fb-68e3-46cb-b143-f71dd1ca0053 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:11 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:58:11 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:58:11 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7120MB free_disk=25.04379653930664GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 89f447d4-22b3-42f7-8830-9facdce3412c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b5d5bf63-c36b-49d4-9b1a-3b0400da8316 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 91a32f0f-91a7-4724-ace4-8a333dee6878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 213eeac2-0579-4b7b-b08c-cb040cd54784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37ba2c90-f471-4c24-ada2-084734722610 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance db61b783-50d7-4304-a031-f9fb11069ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:58:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:58:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:58:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:58:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfnpJZUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:22 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:22 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:22 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad8788-3651-4b03-bf49-54b124773721]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:58:22 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a46a68-2b38-4349-8e39-f0516656e27f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de] added
Aug 14 21:58:22 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ed0fa5-934e-4b86-a86f-d189f037b48e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[63512bcb-fcd3-4d17-827c-74a7111588c1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfnpJZUm {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfnpJZUm" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd674e4-ffe1-4b0d-acc1-5e521000288f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kfnpJZUm'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9920df7-b2db-4ab1-a673-bfa198d27f4f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3aac14-3794-44cb-85fa-53e3f1e4145b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aaa46f-2648-48fd-b9f9-c2fb0aa1fc86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260]
Aug 14 21:58:23 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260] successful.
Aug 14 21:58:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1663a27c-bbb5-4afa-bd6f-c12604af87ce]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796d757-8f90-454f-a9af-a6eb22240c78]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)
Aug 14 21:58:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:23 user nova-compute[73144]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)
Aug 14 21:58:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ffa0a7-ca28-4014-9aeb-881188cb11b3]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:58:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfnpJZUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23438333534626234', 'path': '/dev/sdg'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438333534626234', 'path': '/dev/sdg'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:58:24 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:24 user nova-compute[73144]:   <source dev="/dev/sdg"/>
Aug 14 21:58:24 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 21:58:24 user nova-compute[73144]:   <serial>6e5ba33f-6d57-48dd-99a8-1385896658de</serial>
Aug 14 21:58:24 user nova-compute[73144]: </disk>
Aug 14 21:58:24 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] No VIF found with MAC fa:16:3e:6b:9a:63, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:58:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-456c185f-33c7-484e-a19c-02c510677ad6 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.835s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:25 user nova-compute[73144]: INFO nova.compute.manager [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Detaching volume 2f65d454-b42c-4c29-8a9d-dd55db7aac4f
Aug 14 21:58:25 user nova-compute[73144]: INFO nova.virt.block_device [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Attempting to driver detach volume 2f65d454-b42c-4c29-8a9d-dd55db7aac4f from mountpoint /dev/vdb
Aug 14 21:58:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Attempting to detach device vdb from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:58:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:25 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:58:25 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:58:25 user nova-compute[73144]:   <serial>2f65d454-b42c-4c29-8a9d-dd55db7aac4f</serial>
Aug 14 21:58:25 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:58:25 user nova-compute[73144]: </disk>
Aug 14 21:58:25 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:58:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully detached device vdb from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the persistent domain config.
Aug 14 21:58:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:58:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:25 user nova-compute[73144]:   <source dev="/dev/sdf"/>
Aug 14 21:58:25 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:58:25 user nova-compute[73144]:   <serial>2f65d454-b42c-4c29-8a9d-dd55db7aac4f</serial>
Aug 14 21:58:25 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:58:25 user nova-compute[73144]: </disk>
Aug 14 21:58:25 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050305.9047573, 213eeac2-0579-4b7b-b08c-cb040cd54784 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:58:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully detached device vdb from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the live domain config.
Aug 14 21:58:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otFTpJhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:25 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c6fd3-bc3d-4fe7-ae3b-420c32d73c38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5866bf5-eb94-49c9-a51e-9c6b330e1d6f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)
Aug 14 21:58:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f (non-flash)
Aug 14 21:58:25 user nova-compute[73144]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)
Aug 14 21:58:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158474c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f'): ({'sdf'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Removing single pathed devices sdf {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:58:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6834eda-3da6-48a4-915c-ea7778e531bf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b46d0-6f96-4904-9656-cfe089b64403]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flushing IO for device /dev/sdf {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2fc613-86a5-4d29-81b6-f7b6e5fafdc3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0f5844-6b0a-4dea-8a9a-a74ce5ea4f2f]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[be479efc-2dab-4f99-88ad-ef00bde48d55]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeb719e-c8ad-4f68-aaed-a32b4483c120]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260]
Aug 14 21:58:26 user nova-compute[73144]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f, portal: 172.16.0.220,3260] successful.
Aug 14 21:58:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f65d454-b42c-4c29-8a9d-dd55db7aac4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[63415ff3-7231-4b12-85fb-ba841a61069f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== disconnect_volume: return (309ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-88f0d995-29df-4a17-8f92-9d665e67b10b tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.996s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:27 user nova-compute[73144]: INFO nova.compute.manager [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Detaching volume 6e5ba33f-6d57-48dd-99a8-1385896658de
Aug 14 21:58:27 user nova-compute[73144]: INFO nova.virt.block_device [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Attempting to driver detach volume 6e5ba33f-6d57-48dd-99a8-1385896658de from mountpoint /dev/vdc
Aug 14 21:58:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Attempting to detach device vdc from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:58:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:58:27 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:27 user nova-compute[73144]:   <source dev="/dev/sdg"/>
Aug 14 21:58:27 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 21:58:27 user nova-compute[73144]:   <serial>6e5ba33f-6d57-48dd-99a8-1385896658de</serial>
Aug 14 21:58:27 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 21:58:27 user nova-compute[73144]: </disk>
Aug 14 21:58:27 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:58:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully detached device vdc from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the persistent domain config.
Aug 14 21:58:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:58:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:58:27 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:27 user nova-compute[73144]:   <source dev="/dev/sdg"/>
Aug 14 21:58:27 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 21:58:27 user nova-compute[73144]:   <serial>6e5ba33f-6d57-48dd-99a8-1385896658de</serial>
Aug 14 21:58:27 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 21:58:27 user nova-compute[73144]: </disk>
Aug 14 21:58:27 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050308.2974098, 213eeac2-0579-4b7b-b08c-cb040cd54784 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:58:28 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully detached device vdc from instance 213eeac2-0579-4b7b-b08c-cb040cd54784 from the live domain config.
Aug 14 21:58:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfnpJZUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:28 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a20bd16-bf7e-4d84-80d5-19837c581b80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[30401d72-9438-499c-9a8f-f0c28df38870]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)
Aug 14 21:58:28 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:28 user nova-compute[73144]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de (non-flash)
Aug 14 21:58:28 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158477370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de'): ({'sdg'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Removing single pathed devices sdg {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35ecac2-ed52-429f-a876-461a6cda198a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[033576ea-3362-4270-a846-495c169e4b55]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Flushing IO for device /dev/sdg {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[379eeddc-f95a-4ba2-b454-d7240e099f07]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b5f223-b231-402d-8f77-8f16199af36c]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] SCSI volumes sdg have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3758b26-e4ec-4604-8641-5babd04c565d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04f2880-4578-4211-996a-9b35deef2008]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260]
Aug 14 21:58:28 user nova-compute[73144]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de, portal: 172.16.0.220,3260] successful.
Aug 14 21:58:28 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5ba33f-6d57-48dd-99a8-1385896658de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a55bd5-7f3b-4d05-8ace-f7aabd16f7c4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] <== disconnect_volume: return (298ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:58:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:32 user nova-compute[73144]: DEBUG nova.objects.instance [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'flavor' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-811d5108-3aa1-417f-9fdb-d38e2b325b44 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.208s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:33 user nova-compute[73144]: INFO nova.compute.manager [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Terminating instance
Aug 14 21:58:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-facb0a3c-356c-4b97-9306-549cba7f54f0 req-8c3bc711-7b10-4566-ba71-d23bf9c25113 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-vif-unplugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-facb0a3c-356c-4b97-9306-549cba7f54f0 req-8c3bc711-7b10-4566-ba71-d23bf9c25113 service nova] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-facb0a3c-356c-4b97-9306-549cba7f54f0 req-8c3bc711-7b10-4566-ba71-d23bf9c25113 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-facb0a3c-356c-4b97-9306-549cba7f54f0 req-8c3bc711-7b10-4566-ba71-d23bf9c25113 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-facb0a3c-356c-4b97-9306-549cba7f54f0 req-8c3bc711-7b10-4566-ba71-d23bf9c25113 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] No waiting events found dispatching network-vif-unplugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-facb0a3c-356c-4b97-9306-549cba7f54f0 req-8c3bc711-7b10-4566-ba71-d23bf9c25113 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-vif-unplugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:58:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Instance destroyed successfully.
Aug 14 21:58:34 user nova-compute[73144]: DEBUG nova.objects.instance [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lazy-loading 'resources' on Instance uuid 213eeac2-0579-4b7b-b08c-cb040cd54784 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-521759829',display_name='tempest-AttachVolumeTestJSON-server-521759829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-521759829',id=30,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUPF1Sp07RCgK1MoOjEfuDrJcyvavqUXoUj10UDpR3vqxY44n1JEJPkkIbEhfOP83dL1Hz5vHcYVjUXMNDECjgsryUbrbv3fD+VwoW2i+k68cdn+Mfk9/d1mQckCbI6eg==',key_name='tempest-keypair-1002875952',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:56:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3842f55070374c288d0e1500d297485e',ramdisk_id='',reservation_id='r-ww47148b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-881893264',owner_user_name='tempest-AttachVolumeTestJSON-881893264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f3461a4f8f45e584180e2b18d782b0',uuid=213eeac2-0579-4b7b-b08c-cb040cd54784,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converting VIF {"id": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "address": "fa:16:3e:6b:9a:63", "network": {"id": "0898268d-7ff0-4446-914f-67be9aa570e4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1006350846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3842f55070374c288d0e1500d297485e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70df378f-2f", "ovs_interfaceid": "70df378f-2f27-4b41-84e6-0f12ff4b0321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=70df378f-2f27-4b41-84e6-0f12ff4b0321,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70df378f-2f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG os_vif [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=70df378f-2f27-4b41-84e6-0f12ff4b0321,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70df378f-2f') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70df378f-2f, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:34 user nova-compute[73144]: INFO os_vif [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:9a:63,bridge_name='br-int',has_traffic_filtering=True,id=70df378f-2f27-4b41-84e6-0f12ff4b0321,network=Network(0898268d-7ff0-4446-914f-67be9aa570e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70df378f-2f')
Aug 14 21:58:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Deleting instance files /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784_del
Aug 14 21:58:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Deletion of /opt/stack/data/nova/instances/213eeac2-0579-4b7b-b08c-cb040cd54784_del complete
Aug 14 21:58:34 user nova-compute[73144]: INFO nova.compute.manager [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 21:58:34 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:58:34 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:35 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Took 0.94 seconds to deallocate network for instance.
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-cd495c8e-a7bc-4b3f-af9d-5e56ffaaf637 req-8f1ca759-895a-41a9-b9bb-a4c6ad84c64c service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-vif-deleted-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:35 user nova-compute[73144]: INFO nova.compute.manager [req-cd495c8e-a7bc-4b3f-af9d-5e56ffaaf637 req-8f1ca759-895a-41a9-b9bb-a4c6ad84c64c service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Neutron deleted interface 70df378f-2f27-4b41-84e6-0f12ff4b0321; detaching it from the instance and deleting it from the info cache
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-cd495c8e-a7bc-4b3f-af9d-5e56ffaaf637 req-8f1ca759-895a-41a9-b9bb-a4c6ad84c64c service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-cd495c8e-a7bc-4b3f-af9d-5e56ffaaf637 req-8f1ca759-895a-41a9-b9bb-a4c6ad84c64c service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Detach interface failed, port_id=70df378f-2f27-4b41-84e6-0f12ff4b0321, reason: Instance 213eeac2-0579-4b7b-b08c-cb040cd54784 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-a66d9f36-6744-4efa-8c96-85b9e8d04306 req-457c91a7-f848-41cd-a126-ab384d8d6728 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received event network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a66d9f36-6744-4efa-8c96-85b9e8d04306 req-457c91a7-f848-41cd-a126-ab384d8d6728 service nova] Acquiring lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a66d9f36-6744-4efa-8c96-85b9e8d04306 req-457c91a7-f848-41cd-a126-ab384d8d6728 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a66d9f36-6744-4efa-8c96-85b9e8d04306 req-457c91a7-f848-41cd-a126-ab384d8d6728 service nova] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-a66d9f36-6744-4efa-8c96-85b9e8d04306 req-457c91a7-f848-41cd-a126-ab384d8d6728 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] No waiting events found dispatching network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:35 user nova-compute[73144]: WARNING nova.compute.manager [req-a66d9f36-6744-4efa-8c96-85b9e8d04306 req-457c91a7-f848-41cd-a126-ab384d8d6728 service nova] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Received unexpected event network-vif-plugged-70df378f-2f27-4b41-84e6-0f12ff4b0321 for instance with vm_state deleted and task_state None.
Aug 14 21:58:35 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Deleted allocations for instance 213eeac2-0579-4b7b-b08c-cb040cd54784
Aug 14 21:58:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-3f4cfe66-af8c-4a8e-839a-e1d01bc608f9 tempest-AttachVolumeTestJSON-881893264 tempest-AttachVolumeTestJSON-881893264-project-member] Lock "213eeac2-0579-4b7b-b08c-cb040cd54784" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.422s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-changed-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Refreshing instance network info cache due to event network-changed-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:58:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] Acquiring lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:58:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] Acquired lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:58:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Refreshing network info cache for port 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:58:41 user nova-compute[73144]: DEBUG nova.network.neutron [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updated VIF entry in instance network info cache for port 2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:58:41 user nova-compute[73144]: DEBUG nova.network.neutron [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43f0ba38-f97f-4c6a-bbe5-af379844cca8 req-66ae13cc-8984-4b26-aa1e-b0c69cca1abc service nova] Releasing lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Stashing vm_state: active {{(pid=73144) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.objects.instance [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'pci_requests' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:58:42 user nova-compute[73144]: INFO nova.compute.claims [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Claim successful on node user
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.objects.instance [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'resources' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.objects.instance [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'pci_devices' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:42 user nova-compute[73144]: INFO nova.compute.resource_tracker [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating resource usage from migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-changed-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Refreshing instance network info cache due to event network-changed-648e988b-1d10-4829-932b-88c863dc0cfa. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] Acquiring lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] Acquired lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:58:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Refreshing network info cache for port 648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.497s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:43 user nova-compute[73144]: INFO nova.compute.manager [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Migrating
Aug 14 21:58:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG nova.network.neutron [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updated VIF entry in instance network info cache for port 648e988b-1d10-4829-932b-88c863dc0cfa. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG nova.network.neutron [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating instance_info_cache with network_info: [{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-598766f9-fc2f-4c50-ab89-26924fdb9298 req-725dc7b1-5fd9-4421-9b9e-ad65d4017441 service nova] Releasing lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquired lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:58:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating instance_info_cache with network_info: [{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Releasing lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Starting migrate_disk_and_power_off {{(pid=73144) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-7f4a253f-a988-448d-b93e-77246b2d7c20 req-adc12d6e-4dbc-46c8-8f54-af6f89b5c236 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-unplugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7f4a253f-a988-448d-b93e-77246b2d7c20 req-adc12d6e-4dbc-46c8-8f54-af6f89b5c236 service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7f4a253f-a988-448d-b93e-77246b2d7c20 req-adc12d6e-4dbc-46c8-8f54-af6f89b5c236 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7f4a253f-a988-448d-b93e-77246b2d7c20 req-adc12d6e-4dbc-46c8-8f54-af6f89b5c236 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-7f4a253f-a988-448d-b93e-77246b2d7c20 req-adc12d6e-4dbc-46c8-8f54-af6f89b5c236 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-unplugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:44 user nova-compute[73144]: WARNING nova.compute.manager [req-7f4a253f-a988-448d-b93e-77246b2d7c20 req-adc12d6e-4dbc-46c8-8f54-af6f89b5c236 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received unexpected event network-vif-unplugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with vm_state active and task_state resize_migrating.
Aug 14 21:58:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:45 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance destroyed successfully.
Aug 14 21:58:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-446237050',display_name='tempest-ServerActionsTestOtherA-server-446237050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-446237050',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-0tv7sgub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=37ba2c90-f471-4c24-ada2-084734722610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1711782169-network", "vif_mac": "fa:16:3e:7d:81:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1711782169-network", "vif_mac": "fa:16:3e:7d:81:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_vif [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap648e988b-1d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:45 user nova-compute[73144]: INFO os_vif [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d')
Aug 14 21:58:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:45 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e333a9-3b7d-4ded-9a43-01b5f44922f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7b9dba-1809-4909-8d96-6400de454558]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1787a0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dea84f-4a12-4399-aa10-f7b2405c5a5d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f3a47-3faf-40ca-b4ca-776272cd0540]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c015f-491f-4655-ae28-c1beac49b2dd]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec9b7c7-6bcf-4cfa-a395-620f1dc789f0]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe5ca4289-f9b8a871f657cae0', '/dev/disk/by-id/scsi-26639623861383731', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e5ca4289') {{(pid=84572) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b737fe9b-2f49-4546-96d7-b723ee6e2ccc]: (4, None) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc2422b-8cfc-45f0-a44d-8d320a13bd89]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a003c8-8a4c-421a-acf7-9bfb71ec275c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]
Aug 14 21:58:45 user nova-compute[73144]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.
Aug 14 21:58:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aff452-ca80-4a4d-95fc-93a95f5f620d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== disconnect_volume: return (289ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:58:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Port 648e988b-1d10-4829-932b-88c863dc0cfa binding to destination host user is already ACTIVE {{(pid=73144) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquired lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-963badfe-606e-431b-90df-1c736cd4bb2a req-c318f03a-9c3d-4db4-a19e-343a2268b9fa service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-963badfe-606e-431b-90df-1c736cd4bb2a req-c318f03a-9c3d-4db4-a19e-343a2268b9fa service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-963badfe-606e-431b-90df-1c736cd4bb2a req-c318f03a-9c3d-4db4-a19e-343a2268b9fa service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-963badfe-606e-431b-90df-1c736cd4bb2a req-c318f03a-9c3d-4db4-a19e-343a2268b9fa service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-963badfe-606e-431b-90df-1c736cd4bb2a req-c318f03a-9c3d-4db4-a19e-343a2268b9fa service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:46 user nova-compute[73144]: WARNING nova.compute.manager [req-963badfe-606e-431b-90df-1c736cd4bb2a req-c318f03a-9c3d-4db4-a19e-343a2268b9fa service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received unexpected event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with vm_state active and task_state resize_migrated.
Aug 14 21:58:47 user nova-compute[73144]: DEBUG nova.network.neutron [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating instance_info_cache with network_info: [{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Releasing lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG os_brick.utils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc2476-8943-4433-b010-8ee71f14f52d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f22c3-fa77-4cd6-b0fc-5ffecb16e58e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef4c181-d9d8-4bd2-a0aa-e073cec14a81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d5f733-bb30-4ef4-979d-4df007c9b609]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:58:47 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:58:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec8d73-1dfc-4ff9-a22f-5e6e1bd501e2]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:58:47 user nova-compute[73144]: DEBUG os_brick.utils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:49 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050314.3610685, 213eeac2-0579-4b7b-b08c-cb040cd54784 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:58:49 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] VM Stopped (Lifecycle Event)
Aug 14 21:58:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-11358174-f115-4176-a0ed-92b3abcf4b79 None None] [instance: 213eeac2-0579-4b7b-b08c-cb040cd54784] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:50 user nova-compute[73144]: INFO nova.compute.manager [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Terminating instance
Aug 14 21:58:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-9df660ee-e955-4e13-bea0-a0891e05c581 req-ad123f56-52ed-4ee9-9cf9-b5263ed969cf service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-vif-unplugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9df660ee-e955-4e13-bea0-a0891e05c581 req-ad123f56-52ed-4ee9-9cf9-b5263ed969cf service nova] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9df660ee-e955-4e13-bea0-a0891e05c581 req-ad123f56-52ed-4ee9-9cf9-b5263ed969cf service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9df660ee-e955-4e13-bea0-a0891e05c581 req-ad123f56-52ed-4ee9-9cf9-b5263ed969cf service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-9df660ee-e955-4e13-bea0-a0891e05c581 req-ad123f56-52ed-4ee9-9cf9-b5263ed969cf service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] No waiting events found dispatching network-vif-unplugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-9df660ee-e955-4e13-bea0-a0891e05c581 req-ad123f56-52ed-4ee9-9cf9-b5263ed969cf service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-vif-unplugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:58:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Instance destroyed successfully.
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lazy-loading 'resources' on Instance uuid 91a32f0f-91a7-4724-ace4-8a333dee6878 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-969756107',display_name='tempest-AttachVolumeNegativeTest-server-969756107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-969756107',id=29,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBm2HXcxJAFNoQyOa3+GmKXwT37GV7hJNJW3C2dM93JXra0M7VneAY/D9111CAdCxe20X17gnwZ3zLl+5rPM1dkYMVtB9X/Jjlgl9RRUQe3qhaRgxUZO5yjDxgBxCM71Jw==',key_name='tempest-keypair-614548678',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b004e49247a041b7b00500416a625ca7',ramdisk_id='',reservation_id='r-a6bxdson',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1600069366',owner_user_name='tempest-AttachVolumeNegativeTest-1600069366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='597588abcb1a4963a536b2b078ceef23',uuid=91a32f0f-91a7-4724-ace4-8a333dee6878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converting VIF {"id": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "address": "fa:16:3e:2c:28:9f", "network": {"id": "45a2d371-d0a3-4b78-b14d-89a65582b18e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-173464752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b004e49247a041b7b00500416a625ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e4c67b-c9", "ovs_interfaceid": "b3e4c67b-c987-4848-830f-e644dd36f5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=b3e4c67b-c987-4848-830f-e644dd36f5a9,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e4c67b-c9') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG os_vif [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=b3e4c67b-c987-4848-830f-e644dd36f5a9,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e4c67b-c9') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3e4c67b-c9, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:51 user nova-compute[73144]: INFO os_vif [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=b3e4c67b-c987-4848-830f-e644dd36f5a9,network=Network(45a2d371-d0a3-4b78-b14d-89a65582b18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e4c67b-c9')
Aug 14 21:58:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Deleting instance files /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878_del
Aug 14 21:58:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Deletion of /opt/stack/data/nova/instances/91a32f0f-91a7-4724-ace4-8a333dee6878_del complete
Aug 14 21:58:51 user nova-compute[73144]: INFO nova.compute.manager [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 21:58:51 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:58:51 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:58:52 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:52 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Took 0.87 seconds to deallocate network for instance.
Aug 14 21:58:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-6680f581-57be-42cd-b86d-307db16e6790 req-2797916d-ec6c-456a-9f71-1ed685e4ea95 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-vif-deleted-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:52 user nova-compute[73144]: INFO nova.compute.manager [req-6680f581-57be-42cd-b86d-307db16e6790 req-2797916d-ec6c-456a-9f71-1ed685e4ea95 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Neutron deleted interface b3e4c67b-c987-4848-830f-e644dd36f5a9; detaching it from the instance and deleting it from the info cache
Aug 14 21:58:52 user nova-compute[73144]: DEBUG nova.network.neutron [req-6680f581-57be-42cd-b86d-307db16e6790 req-2797916d-ec6c-456a-9f71-1ed685e4ea95 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:58:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-6680f581-57be-42cd-b86d-307db16e6790 req-2797916d-ec6c-456a-9f71-1ed685e4ea95 service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Detach interface failed, port_id=b3e4c67b-c987-4848-830f-e644dd36f5a9, reason: Instance 91a32f0f-91a7-4724-ace4-8a333dee6878 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:58:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:52 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:58:52 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:58:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:53 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Deleted allocations for instance 91a32f0f-91a7-4724-ace4-8a333dee6878
Aug 14 21:58:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1374052-949d-4199-bab8-cee46396bceb tempest-AttachVolumeNegativeTest-1600069366 tempest-AttachVolumeNegativeTest-1600069366-project-member] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.356s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-16e5cc70-a1ba-4b09-8281-c218d28a6c17 req-915c7652-8963-4e35-8658-1cbe33d9648b service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received event network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-16e5cc70-a1ba-4b09-8281-c218d28a6c17 req-915c7652-8963-4e35-8658-1cbe33d9648b service nova] Acquiring lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-16e5cc70-a1ba-4b09-8281-c218d28a6c17 req-915c7652-8963-4e35-8658-1cbe33d9648b service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-16e5cc70-a1ba-4b09-8281-c218d28a6c17 req-915c7652-8963-4e35-8658-1cbe33d9648b service nova] Lock "91a32f0f-91a7-4724-ace4-8a333dee6878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-16e5cc70-a1ba-4b09-8281-c218d28a6c17 req-915c7652-8963-4e35-8658-1cbe33d9648b service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] No waiting events found dispatching network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:53 user nova-compute[73144]: WARNING nova.compute.manager [req-16e5cc70-a1ba-4b09-8281-c218d28a6c17 req-915c7652-8963-4e35-8658-1cbe33d9648b service nova] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Received unexpected event network-vif-plugged-b3e4c67b-c987-4848-830f-e644dd36f5a9 for instance with vm_state deleted and task_state None.
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Starting finish_migration {{(pid=73144) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 21:58:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Creating image(s)
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Ensure instance console log exists: /opt/stack/data/nova/instances/37ba2c90-f471-4c24-ada2-084734722610/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Start _get_guest_xml network_info=[{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1711782169-network", "vif_mac": "fa:16:3e:7d:81:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '2f22dedf-45e0-4603-8a22-17792306776d', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '37ba2c90-f471-4c24-ada2-084734722610', 'attached_at': '2023-08-14T21:58:56.000000', 'detached_at': '', 'volume_id': '582a8584-1c29-4bc1-ab9a-fac4705091d2', 'serial': '582a8584-1c29-4bc1-ab9a-fac4705091d2'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:58:56 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:58:56 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.objects.instance [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:58:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:58:56 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bfb181-c8f4-4812-a490-15a2b23b2665]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:58:56 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34a69cf-4914-40e7-8bd4-64a41d12696e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2] added
Aug 14 21:58:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c81205e-d89d-4f18-8c55-b82b16f00a52]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[61242441-f1d8-4bcd-926c-eff6461fb74c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnzgOpiN {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnzgOpiN" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b37ddd-ed08-447b-af43-3e9c82eec046]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GnzgOpiN'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73bd8e-1e2c-4b31-9c68-cb6ca650ded4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bc11eb-0a81-44bd-b761-f91793288726]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ef5f89-4104-49b1-a427-17153ad847a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]
Aug 14 21:58:56 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.
Aug 14 21:58:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a457e42-ad53-4237-9a13-c59c14e2b0d6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8efbdc-0923-4758-8d1f-86b60cb4b853]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:58:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0724fc-f005-4113-aa34-9b96e68ae1ed]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:58:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26639623861383731', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639623861383731', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-446237050',display_name='tempest-ServerActionsTestOtherA-server-446237050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-446237050',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-0tv7sgub',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=37ba2c90-f471-4c24-ada2-084734722610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1711782169-network", "vif_mac": "fa:16:3e:7d:81:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1711782169-network", "vif_mac": "fa:16:3e:7d:81:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:58:57 user nova-compute[73144]:   <uuid>37ba2c90-f471-4c24-ada2-084734722610</uuid>
Aug 14 21:58:57 user nova-compute[73144]:   <name>instance-0000001f</name>
Aug 14 21:58:57 user nova-compute[73144]:   <memory>2097152</memory>
Aug 14 21:58:57 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:58:57 user nova-compute[73144]:   <metadata>
Aug 14 21:58:57 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:58:57 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:58:57 user nova-compute[73144]:       <nova:name>tempest-ServerActionsTestOtherA-server-446237050</nova:name>
Aug 14 21:58:57 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:58:56</nova:creationTime>
Aug 14 21:58:57 user nova-compute[73144]:       <nova:flavor name="m1.small">
Aug 14 21:58:57 user nova-compute[73144]:         <nova:memory>2048</nova:memory>
Aug 14 21:58:57 user nova-compute[73144]:         <nova:disk>20</nova:disk>
Aug 14 21:58:57 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:58:57 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:58:57 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:58:57 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:58:57 user nova-compute[73144]:       <nova:owner>
Aug 14 21:58:57 user nova-compute[73144]:         <nova:user uuid="f236788f6a93453b893ddf6d4cf01c1c">tempest-ServerActionsTestOtherA-202206255-project-member</nova:user>
Aug 14 21:58:57 user nova-compute[73144]:         <nova:project uuid="fe2005f37baf4b1b99effc98fddd0fdc">tempest-ServerActionsTestOtherA-202206255</nova:project>
Aug 14 21:58:57 user nova-compute[73144]:       </nova:owner>
Aug 14 21:58:57 user nova-compute[73144]:       <nova:ports>
Aug 14 21:58:57 user nova-compute[73144]:         <nova:port uuid="648e988b-1d10-4829-932b-88c863dc0cfa">
Aug 14 21:58:57 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 21:58:57 user nova-compute[73144]:         </nova:port>
Aug 14 21:58:57 user nova-compute[73144]:       </nova:ports>
Aug 14 21:58:57 user nova-compute[73144]:     </nova:instance>
Aug 14 21:58:57 user nova-compute[73144]:   </metadata>
Aug 14 21:58:57 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:58:57 user nova-compute[73144]:     <system>
Aug 14 21:58:57 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:58:57 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:58:57 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:58:57 user nova-compute[73144]:       <entry name="serial">37ba2c90-f471-4c24-ada2-084734722610</entry>
Aug 14 21:58:57 user nova-compute[73144]:       <entry name="uuid">37ba2c90-f471-4c24-ada2-084734722610</entry>
Aug 14 21:58:57 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:58:57 user nova-compute[73144]:     </system>
Aug 14 21:58:57 user nova-compute[73144]:   </sysinfo>
Aug 14 21:58:57 user nova-compute[73144]:   <os>
Aug 14 21:58:57 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:58:57 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:58:57 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:58:57 user nova-compute[73144]:   </os>
Aug 14 21:58:57 user nova-compute[73144]:   <features>
Aug 14 21:58:57 user nova-compute[73144]:     <acpi/>
Aug 14 21:58:57 user nova-compute[73144]:     <apic/>
Aug 14 21:58:57 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:58:57 user nova-compute[73144]:   </features>
Aug 14 21:58:57 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:58:57 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:58:57 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:58:57 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:58:57 user nova-compute[73144]:   </clock>
Aug 14 21:58:57 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:58:57 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:58:57 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:58:57 user nova-compute[73144]:   </cpu>
Aug 14 21:58:57 user nova-compute[73144]:   <devices>
Aug 14 21:58:57 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 21:58:57 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:58:57 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 21:58:57 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:58:57 user nova-compute[73144]:       <serial>582a8584-1c29-4bc1-ab9a-fac4705091d2</serial>
Aug 14 21:58:57 user nova-compute[73144]:     </disk>
Aug 14 21:58:57 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:58:57 user nova-compute[73144]:       <mac address="fa:16:3e:7d:81:4b"/>
Aug 14 21:58:57 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:58:57 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:58:57 user nova-compute[73144]:       <target dev="tap648e988b-1d"/>
Aug 14 21:58:57 user nova-compute[73144]:     </interface>
Aug 14 21:58:57 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:58:57 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/37ba2c90-f471-4c24-ada2-084734722610/console.log" append="off"/>
Aug 14 21:58:57 user nova-compute[73144]:     </serial>
Aug 14 21:58:57 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:58:57 user nova-compute[73144]:     <video>
Aug 14 21:58:57 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:58:57 user nova-compute[73144]:     </video>
Aug 14 21:58:57 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:58:57 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:58:57 user nova-compute[73144]:     </rng>
Aug 14 21:58:57 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:58:57 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:58:57 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:58:57 user nova-compute[73144]:     </memballoon>
Aug 14 21:58:57 user nova-compute[73144]:   </devices>
Aug 14 21:58:57 user nova-compute[73144]: </domain>
Aug 14 21:58:57 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-446237050',display_name='tempest-ServerActionsTestOtherA-server-446237050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-446237050',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-0tv7sgub',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=37ba2c90-f471-4c24-ada2-084734722610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1711782169-network", "vif_mac": "fa:16:3e:7d:81:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1711782169-network", "vif_mac": "fa:16:3e:7d:81:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG os_vif [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap648e988b-1d, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap648e988b-1d, col_values=(('external_ids', {'iface-id': '648e988b-1d10-4829-932b-88c863dc0cfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:81:4b', 'vm-uuid': '37ba2c90-f471-4c24-ada2-084734722610'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:57 user nova-compute[73144]: INFO os_vif [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d')
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:58:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] No VIF found with MAC fa:16:3e:7d:81:4b, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-724a7f3d-42d9-4a4e-8a7b-b3144dd1659c req-4394d3ab-823e-43c2-8966-6c890fdf92e4 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-724a7f3d-42d9-4a4e-8a7b-b3144dd1659c req-4394d3ab-823e-43c2-8966-6c890fdf92e4 service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-724a7f3d-42d9-4a4e-8a7b-b3144dd1659c req-4394d3ab-823e-43c2-8966-6c890fdf92e4 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-724a7f3d-42d9-4a4e-8a7b-b3144dd1659c req-4394d3ab-823e-43c2-8966-6c890fdf92e4 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-724a7f3d-42d9-4a4e-8a7b-b3144dd1659c req-4394d3ab-823e-43c2-8966-6c890fdf92e4 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:58:59 user nova-compute[73144]: WARNING nova.compute.manager [req-724a7f3d-42d9-4a4e-8a7b-b3144dd1659c req-4394d3ab-823e-43c2-8966-6c890fdf92e4 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received unexpected event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with vm_state active and task_state resize_finish.
Aug 14 21:58:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:58:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:00 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050325.2566442, 37ba2c90-f471-4c24-ada2-084734722610 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:00 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] VM Stopped (Lifecycle Event)
Aug 14 21:59:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-338bae57-f362-4c11-ba7f-e2276dccc42a None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050341.2771518, 37ba2c90-f471-4c24-ada2-084734722610 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] VM Resumed (Lifecycle Event)
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:59:01 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance running successfully.
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Failed to set time: agent not configured {{(pid=73144) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-99906de3-45c5-414c-bd07-165e960580ba tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] finish_migration finished successfully. {{(pid=73144) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:59:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050341.2829435, 37ba2c90-f471-4c24-ada2-084734722610 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] VM Started (Lifecycle Event)
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:59:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-6c87eb9d-bd59-448c-bd2e-76f2940cbfb2 req-aaa3bd5d-a278-484e-af3f-236350ec6ccf service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6c87eb9d-bd59-448c-bd2e-76f2940cbfb2 req-aaa3bd5d-a278-484e-af3f-236350ec6ccf service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6c87eb9d-bd59-448c-bd2e-76f2940cbfb2 req-aaa3bd5d-a278-484e-af3f-236350ec6ccf service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6c87eb9d-bd59-448c-bd2e-76f2940cbfb2 req-aaa3bd5d-a278-484e-af3f-236350ec6ccf service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-6c87eb9d-bd59-448c-bd2e-76f2940cbfb2 req-aaa3bd5d-a278-484e-af3f-236350ec6ccf service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:01 user nova-compute[73144]: WARNING nova.compute.manager [req-6c87eb9d-bd59-448c-bd2e-76f2940cbfb2 req-aaa3bd5d-a278-484e-af3f-236350ec6ccf service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received unexpected event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with vm_state active and task_state resize_finish.
Aug 14 21:59:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:02 user nova-compute[73144]: INFO nova.compute.manager [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Terminating instance
Aug 14 21:59:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-08d2e591-7aef-4f42-a7e1-135499c5ef78 req-e4c2a8ce-dc8c-4a09-8890-26a6e3228f56 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-unplugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-08d2e591-7aef-4f42-a7e1-135499c5ef78 req-e4c2a8ce-dc8c-4a09-8890-26a6e3228f56 service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-08d2e591-7aef-4f42-a7e1-135499c5ef78 req-e4c2a8ce-dc8c-4a09-8890-26a6e3228f56 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-08d2e591-7aef-4f42-a7e1-135499c5ef78 req-e4c2a8ce-dc8c-4a09-8890-26a6e3228f56 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-08d2e591-7aef-4f42-a7e1-135499c5ef78 req-e4c2a8ce-dc8c-4a09-8890-26a6e3228f56 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-unplugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-08d2e591-7aef-4f42-a7e1-135499c5ef78 req-e4c2a8ce-dc8c-4a09-8890-26a6e3228f56 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-unplugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:59:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Instance destroyed successfully.
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lazy-loading 'resources' on Instance uuid b5d5bf63-c36b-49d4-9b1a-3b0400da8316 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-220476942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-261204191',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHZ/e53IiXo6wTwFCWP7MyIA/+2p/UAF9onpbLfhRdUpeTv4HK3RFYiXgJwZ6y8AcG53B74dTrxD9Wz7m4me6N5B1p7lg9g9vcR7+533T45GrcOu2F3MXDk2DK2Iu7Nw==',key_name='tempest-keypair-1594252963',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:57:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120d1e9570db4175920fa929cceb5dca',ramdisk_id='',reservation_id='r-ll5f8vwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866803179',owner_user_name='tempest-ServerActionsV293TestJSON-1866803179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb0f6e9d9c44114b6264802443c6e92',uuid=b5d5bf63-c36b-49d4-9b1a-3b0400da8316,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converting VIF {"id": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "address": "fa:16:3e:6d:27:42", "network": {"id": "adbbac8a-4baf-4351-a11a-61b02db40af4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1585303970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120d1e9570db4175920fa929cceb5dca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee31ef-96", "ovs_interfaceid": "53ee31ef-9655-4010-97f0-cbba5f46dd25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_vif [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ee31ef-96, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:59:03 user nova-compute[73144]: INFO os_vif [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:27:42,bridge_name='br-int',has_traffic_filtering=True,id=53ee31ef-9655-4010-97f0-cbba5f46dd25,network=Network(adbbac8a-4baf-4351-a11a-61b02db40af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee31ef-96')
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuRWPyYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:59:03 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bafd1d-7066-4026-9022-7133a98c7e9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[af715a6e-6e2c-495e-8c14-470491057bdf]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa158688040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7111b57c-7b5f-4d0c-a998-59ce1ed11671]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7bb2b5-a5a7-4160-9cba-40c0da81a58f]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb9d59-e833-4d86-a153-3b16ca2e5dd4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[91249d45-388b-4906-9a02-52bce19de7ab]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a049b0-6bfc-438d-abe1-588c65c5b7ec]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f61dc3-d61d-4290-b09f-b7b9a87db1e6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260]
Aug 14 21:59:03 user nova-compute[73144]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230, portal: 172.16.0.220,3260] successful.
Aug 14 21:59:03 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06162af-f987-4cb8-aee8-7588733ce230 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[763f6db6-7bef-4830-ba42-5e9122650d17]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] <== disconnect_volume: return (342ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:59:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Deleting instance files /opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316_del
Aug 14 21:59:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Deletion of /opt/stack/data/nova/instances/b5d5bf63-c36b-49d4-9b1a-3b0400da8316_del complete
Aug 14 21:59:03 user nova-compute[73144]: INFO nova.compute.manager [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 14 21:59:03 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:59:03 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:59:04 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:04 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:04 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Took 1.05 seconds to deallocate network for instance.
Aug 14 21:59:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-47865dbc-5e32-4dff-9ff1-be26b3bde62c req-e4ebfd9a-c21e-4f13-8e11-055ef512eccb service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-deleted-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-05672f67-8cb9-4788-beef-567bc5b9a6be req-2f378d63-f69b-4710-befe-c9f6ccdf1958 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-05672f67-8cb9-4788-beef-567bc5b9a6be req-2f378d63-f69b-4710-befe-c9f6ccdf1958 service nova] Acquiring lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-05672f67-8cb9-4788-beef-567bc5b9a6be req-2f378d63-f69b-4710-befe-c9f6ccdf1958 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-05672f67-8cb9-4788-beef-567bc5b9a6be req-2f378d63-f69b-4710-befe-c9f6ccdf1958 service nova] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-05672f67-8cb9-4788-beef-567bc5b9a6be req-2f378d63-f69b-4710-befe-c9f6ccdf1958 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] No waiting events found dispatching network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:04 user nova-compute[73144]: WARNING nova.compute.manager [req-05672f67-8cb9-4788-beef-567bc5b9a6be req-2f378d63-f69b-4710-befe-c9f6ccdf1958 service nova] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Received unexpected event network-vif-plugged-53ee31ef-9655-4010-97f0-cbba5f46dd25 for instance with vm_state active and task_state deleting.
Aug 14 21:59:05 user nova-compute[73144]: INFO nova.compute.manager [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Took 0.91 seconds to detach 1 volumes for instance.
Aug 14 21:59:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Deleting volume: e06162af-f987-4cb8-aee8-7588733ce230 {{(pid=73144) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 21:59:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:06 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Deleted allocations for instance b5d5bf63-c36b-49d4-9b1a-3b0400da8316
Aug 14 21:59:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050331.5532045, 91a32f0f-91a7-4724-ace4-8a333dee6878 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:06 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] VM Stopped (Lifecycle Event)
Aug 14 21:59:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4083bd9a-c9a4-4225-8c59-80a608262d4e tempest-ServerActionsV293TestJSON-1866803179 tempest-ServerActionsV293TestJSON-1866803179-project-member] Lock "b5d5bf63-c36b-49d4-9b1a-3b0400da8316" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.029s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-58e7e64c-fdf3-450c-9e2a-618db26a528c None None] [instance: 91a32f0f-91a7-4724-ace4-8a333dee6878] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:59:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:10 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:59:10 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.09451675415039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Applying migration context for instance 37ba2c90-f471-4c24-ada2-084734722610 as it has an incoming, in-progress migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd. Migration status is finished {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 21:59:10 user nova-compute[73144]: INFO nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating resource usage from migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 89f447d4-22b3-42f7-8830-9facdce3412c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance db61b783-50d7-4304-a031-f9fb11069ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37ba2c90-f471-4c24-ada2-084734722610 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:59:10 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:59:11 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:59:11 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:59:11 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:59:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:59:12 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid b38d8d04-d91a-49d3-9350-e44d2ba576cf {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [{"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-b38d8d04-d91a-49d3-9350-e44d2ba576cf" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:59:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:59:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:59:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:14 user nova-compute[73144]: INFO nova.compute.manager [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Terminating instance
Aug 14 21:59:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-d562be89-ff9f-42d4-b503-080067df20b2 req-c1603d06-f7b6-4a65-9466-9e7a7944ae80 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-unplugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d562be89-ff9f-42d4-b503-080067df20b2 req-c1603d06-f7b6-4a65-9466-9e7a7944ae80 service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d562be89-ff9f-42d4-b503-080067df20b2 req-c1603d06-f7b6-4a65-9466-9e7a7944ae80 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d562be89-ff9f-42d4-b503-080067df20b2 req-c1603d06-f7b6-4a65-9466-9e7a7944ae80 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-d562be89-ff9f-42d4-b503-080067df20b2 req-c1603d06-f7b6-4a65-9466-9e7a7944ae80 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-unplugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-d562be89-ff9f-42d4-b503-080067df20b2 req-c1603d06-f7b6-4a65-9466-9e7a7944ae80 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-unplugged-25845491-fe11-4220-8641-c32668bd0b0f for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Instance destroyed successfully.
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lazy-loading 'resources' on Instance uuid 89f447d4-22b3-42f7-8830-9facdce3412c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1409180542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1409180542',id=25,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4t1KtQofX0cMHM3SICsEr2rAdfaE2wiR8BSrzG9+tLGnzk41OqtFUGWr3xM3tag2vxhJoRBCrkHCi8hXw+jUkNYteMdeO7EQMQEcKMBf7Jl6VoLwsx58KOeQPHByasDA==',key_name='tempest-keypair-722661810',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3174ac5ed0da4e0faa1404a52ccc760f',ramdisk_id='',reservation_id='r-oswh5u0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-643572001',owner_user_name='tempest-TaggedAttachmentsTest-643572001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1f449772884d49a1d6355fd3c49908',uuid=89f447d4-22b3-42f7-8830-9facdce3412c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converting VIF {"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:af:d0,bridge_name='br-int',has_traffic_filtering=True,id=25845491-fe11-4220-8641-c32668bd0b0f,network=Network(5f5f4c34-7b3e-4007-a54d-ffac230af0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25845491-fe') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG os_vif [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:af:d0,bridge_name='br-int',has_traffic_filtering=True,id=25845491-fe11-4220-8641-c32668bd0b0f,network=Network(5f5f4c34-7b3e-4007-a54d-ffac230af0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25845491-fe') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25845491-fe, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:15 user nova-compute[73144]: INFO os_vif [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:af:d0,bridge_name='br-int',has_traffic_filtering=True,id=25845491-fe11-4220-8641-c32668bd0b0f,network=Network(5f5f4c34-7b3e-4007-a54d-ffac230af0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25845491-fe')
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T21:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1409180542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1409180542',id=25,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4t1KtQofX0cMHM3SICsEr2rAdfaE2wiR8BSrzG9+tLGnzk41OqtFUGWr3xM3tag2vxhJoRBCrkHCi8hXw+jUkNYteMdeO7EQMQEcKMBf7Jl6VoLwsx58KOeQPHByasDA==',key_name='tempest-keypair-722661810',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3174ac5ed0da4e0faa1404a52ccc760f',ramdisk_id='',reservation_id='r-oswh5u0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-643572001',owner_user_name='tempest-TaggedAttachmentsTest-643572001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1f449772884d49a1d6355fd3c49908',uuid=89f447d4-22b3-42f7-8830-9facdce3412c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converting VIF {"id": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "address": "fa:16:3e:90:dc:0e", "network": {"id": "d4497ae2-682a-4c3e-b9ac-e39a742b44d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852204861", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270080ab-0d", "ovs_interfaceid": "270080ab-0d5e-4a7a-80ee-a038bbf927a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=270080ab-0d5e-4a7a-80ee-a038bbf927a9,network=Network(d4497ae2-682a-4c3e-b9ac-e39a742b44d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270080ab-0d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG os_vif [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=270080ab-0d5e-4a7a-80ee-a038bbf927a9,network=Network(d4497ae2-682a-4c3e-b9ac-e39a742b44d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270080ab-0d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap270080ab-0d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:59:15 user nova-compute[73144]: INFO os_vif [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=270080ab-0d5e-4a7a-80ee-a038bbf927a9,network=Network(d4497ae2-682a-4c3e-b9ac-e39a742b44d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270080ab-0d')
Aug 14 21:59:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Deleting instance files /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c_del
Aug 14 21:59:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Deletion of /opt/stack/data/nova/instances/89f447d4-22b3-42f7-8830-9facdce3412c_del complete
Aug 14 21:59:15 user nova-compute[73144]: INFO nova.compute.manager [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 14 21:59:15 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-2eba4280-6feb-4727-8138-b5d3397775b7 req-d547dcbd-eb71-4b22-9c1a-0bd0319f0c28 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-deleted-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:15 user nova-compute[73144]: INFO nova.compute.manager [req-2eba4280-6feb-4727-8138-b5d3397775b7 req-d547dcbd-eb71-4b22-9c1a-0bd0319f0c28 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Neutron deleted interface 270080ab-0d5e-4a7a-80ee-a038bbf927a9; detaching it from the instance and deleting it from the info cache
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-2eba4280-6feb-4727-8138-b5d3397775b7 req-d547dcbd-eb71-4b22-9c1a-0bd0319f0c28 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating instance_info_cache with network_info: [{"id": "25845491-fe11-4220-8641-c32668bd0b0f", "address": "fa:16:3e:2b:af:d0", "network": {"id": "5f5f4c34-7b3e-4007-a54d-ffac230af0be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-34478622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3174ac5ed0da4e0faa1404a52ccc760f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25845491-fe", "ovs_interfaceid": "25845491-fe11-4220-8641-c32668bd0b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-2eba4280-6feb-4727-8138-b5d3397775b7 req-d547dcbd-eb71-4b22-9c1a-0bd0319f0c28 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Detach interface failed, port_id=270080ab-0d5e-4a7a-80ee-a038bbf927a9, reason: Instance 89f447d4-22b3-42f7-8830-9facdce3412c could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:16 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Took 1.37 seconds to deallocate network for instance.
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:16 user nova-compute[73144]: WARNING nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received unexpected event network-vif-plugged-25845491-fe11-4220-8641-c32668bd0b0f for instance with vm_state active and task_state deleting.
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-unplugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-unplugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-unplugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Acquiring lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] Lock "89f447d4-22b3-42f7-8830-9facdce3412c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] No waiting events found dispatching network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:16 user nova-compute[73144]: WARNING nova.compute.manager [req-4cb780bf-6021-4939-b1c6-2bf38245e83d req-15dd15e0-2996-4604-83c1-144f58ed61e1 service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received unexpected event network-vif-plugged-270080ab-0d5e-4a7a-80ee-a038bbf927a9 for instance with vm_state active and task_state deleting.
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:17 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:59:17 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:59:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:17 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Deleted allocations for instance 89f447d4-22b3-42f7-8830-9facdce3412c
Aug 14 21:59:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9d1ecf92-df6d-4cea-b741-64aeb0e62ffc tempest-TaggedAttachmentsTest-643572001 tempest-TaggedAttachmentsTest-643572001-project-member] Lock "89f447d4-22b3-42f7-8830-9facdce3412c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.947s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-336ac51b-1404-49cb-a058-d5966aa11794 req-f7bb245a-7610-4904-af24-af0ae0960fdc service nova] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Received event network-vif-deleted-25845491-fe11-4220-8641-c32668bd0b0f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:18 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050343.3366022, b5d5bf63-c36b-49d4-9b1a-3b0400da8316 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:18 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] VM Stopped (Lifecycle Event)
Aug 14 21:59:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a6cd01b0-37fd-47d4-8b17-55fd937c49c4 None None] [instance: b5d5bf63-c36b-49d4-9b1a-3b0400da8316] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:59:21 user nova-compute[73144]: INFO nova.compute.claims [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Claim successful on node user
Aug 14 21:59:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:59:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:59:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.policy [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d90a89f0b384bfbbabfc57e098efc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc2faa54982470a8ff513ec75cf0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:59:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Creating image(s)
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.172s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk 1073741824" returned: 0 in 0.059s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Successfully created port: b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Cannot resize image /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG nova.objects.instance [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'migration_context' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Ensure instance console log exists: /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Successfully updated port: b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:59:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing instance network info cache due to event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] Acquiring lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance network_info: |[{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] Acquired lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Start _get_guest_xml network_info=[{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:59:24 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:59:24 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944081948',display_name='tempest-ServerRescueNegativeTestJSON-server-944081948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944081948',id=33,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTxvFBpA115FRLzrCvh9O4wn7LkFvcpc5chtex4LDkdpOfKw8PHe6LbUNmXc+k8oMdCHMqCUtthA30tOtsLMkNZ5VBAgvGuhT2XkWx67lJ2Jx0LDdk8nGIkJwQjdgh+Rg==',key_name='tempest-keypair-417536897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ju0iijj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'pci_devices' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:59:24 user nova-compute[73144]:   <uuid>f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66</uuid>
Aug 14 21:59:24 user nova-compute[73144]:   <name>instance-00000021</name>
Aug 14 21:59:24 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:59:24 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:59:24 user nova-compute[73144]:   <metadata>
Aug 14 21:59:24 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:59:24 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:59:24 user nova-compute[73144]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-944081948</nova:name>
Aug 14 21:59:24 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:59:24</nova:creationTime>
Aug 14 21:59:24 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:59:24 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:59:24 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:59:24 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:59:24 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:59:24 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:59:24 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:59:24 user nova-compute[73144]:       <nova:owner>
Aug 14 21:59:24 user nova-compute[73144]:         <nova:user uuid="8d90a89f0b384bfbbabfc57e098efc45">tempest-ServerRescueNegativeTestJSON-89538024-project-member</nova:user>
Aug 14 21:59:24 user nova-compute[73144]:         <nova:project uuid="8cc2faa54982470a8ff513ec75cf0546">tempest-ServerRescueNegativeTestJSON-89538024</nova:project>
Aug 14 21:59:24 user nova-compute[73144]:       </nova:owner>
Aug 14 21:59:24 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:59:24 user nova-compute[73144]:       <nova:ports>
Aug 14 21:59:24 user nova-compute[73144]:         <nova:port uuid="b484bc7b-fb19-4a51-ab9b-aafb744e31ff">
Aug 14 21:59:24 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 21:59:24 user nova-compute[73144]:         </nova:port>
Aug 14 21:59:24 user nova-compute[73144]:       </nova:ports>
Aug 14 21:59:24 user nova-compute[73144]:     </nova:instance>
Aug 14 21:59:24 user nova-compute[73144]:   </metadata>
Aug 14 21:59:24 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:59:24 user nova-compute[73144]:     <system>
Aug 14 21:59:24 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:59:24 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:59:24 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:59:24 user nova-compute[73144]:       <entry name="serial">f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66</entry>
Aug 14 21:59:24 user nova-compute[73144]:       <entry name="uuid">f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66</entry>
Aug 14 21:59:24 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:59:24 user nova-compute[73144]:     </system>
Aug 14 21:59:24 user nova-compute[73144]:   </sysinfo>
Aug 14 21:59:24 user nova-compute[73144]:   <os>
Aug 14 21:59:24 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:59:24 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:59:24 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:59:24 user nova-compute[73144]:   </os>
Aug 14 21:59:24 user nova-compute[73144]:   <features>
Aug 14 21:59:24 user nova-compute[73144]:     <acpi/>
Aug 14 21:59:24 user nova-compute[73144]:     <apic/>
Aug 14 21:59:24 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:59:24 user nova-compute[73144]:   </features>
Aug 14 21:59:24 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:59:24 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:59:24 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:59:24 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:59:24 user nova-compute[73144]:   </clock>
Aug 14 21:59:24 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:59:24 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:59:24 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:59:24 user nova-compute[73144]:   </cpu>
Aug 14 21:59:24 user nova-compute[73144]:   <devices>
Aug 14 21:59:24 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:59:24 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:59:24 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk"/>
Aug 14 21:59:24 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:59:24 user nova-compute[73144]:     </disk>
Aug 14 21:59:24 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:59:24 user nova-compute[73144]:       <mac address="fa:16:3e:e0:d1:46"/>
Aug 14 21:59:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:59:24 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:59:24 user nova-compute[73144]:       <target dev="tapb484bc7b-fb"/>
Aug 14 21:59:24 user nova-compute[73144]:     </interface>
Aug 14 21:59:24 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:59:24 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/console.log" append="off"/>
Aug 14 21:59:24 user nova-compute[73144]:     </serial>
Aug 14 21:59:24 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:59:24 user nova-compute[73144]:     <video>
Aug 14 21:59:24 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:59:24 user nova-compute[73144]:     </video>
Aug 14 21:59:24 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:59:24 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:59:24 user nova-compute[73144]:     </rng>
Aug 14 21:59:24 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:59:24 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:59:24 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:59:24 user nova-compute[73144]:     </memballoon>
Aug 14 21:59:24 user nova-compute[73144]:   </devices>
Aug 14 21:59:24 user nova-compute[73144]: </domain>
Aug 14 21:59:24 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944081948',display_name='tempest-ServerRescueNegativeTestJSON-server-944081948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944081948',id=33,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTxvFBpA115FRLzrCvh9O4wn7LkFvcpc5chtex4LDkdpOfKw8PHe6LbUNmXc+k8oMdCHMqCUtthA30tOtsLMkNZ5VBAgvGuhT2XkWx67lJ2Jx0LDdk8nGIkJwQjdgh+Rg==',key_name='tempest-keypair-417536897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ju0iijj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG os_vif [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb484bc7b-fb, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb484bc7b-fb, col_values=(('external_ids', {'iface-id': 'b484bc7b-fb19-4a51-ab9b-aafb744e31ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:d1:46', 'vm-uuid': 'f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:24 user nova-compute[73144]: INFO os_vif [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb')
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:59:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No VIF found with MAC fa:16:3e:e0:d1:46, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.network.neutron [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updated VIF entry in instance network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.network.neutron [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-785a036a-2b01-4872-a671-79bfe4cf1ca1 req-93ac982c-ac4d-46d8-bfc6-9f491e881178 service nova] Releasing lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:25 user nova-compute[73144]: INFO nova.compute.manager [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Detaching volume cc871012-d411-41ef-b756-0c516e0b06e2
Aug 14 21:59:25 user nova-compute[73144]: INFO nova.virt.block_device [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Attempting to driver detach volume cc871012-d411-41ef-b756-0c516e0b06e2 from mountpoint /dev/vdc
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Attempting to detach device vdc from instance db61b783-50d7-4304-a031-f9fb11069ef1 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:59:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:59:25 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:59:25 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 21:59:25 user nova-compute[73144]:   <serial>cc871012-d411-41ef-b756-0c516e0b06e2</serial>
Aug 14 21:59:25 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 21:59:25 user nova-compute[73144]: </disk>
Aug 14 21:59:25 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:59:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully detached device vdc from instance db61b783-50d7-4304-a031-f9fb11069ef1 from the persistent domain config.
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance db61b783-50d7-4304-a031-f9fb11069ef1 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:59:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:59:25 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 21:59:25 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 21:59:25 user nova-compute[73144]:   <serial>cc871012-d411-41ef-b756-0c516e0b06e2</serial>
Aug 14 21:59:25 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 21:59:25 user nova-compute[73144]: </disk>
Aug 14 21:59:25 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050365.6448214, db61b783-50d7-4304-a031-f9fb11069ef1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:59:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully detached device vdc from instance db61b783-50d7-4304-a031-f9fb11069ef1 from the live domain config.
Aug 14 21:59:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrsMqOtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:59:25 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3ab9c0-84b5-432a-9e13-51a4989a5d4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e9f75e-70a5-4e1a-b067-94bcb5974354]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:25 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:59:25 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:25 user nova-compute[73144]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 (non-flash)
Aug 14 21:59:25 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17832d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7696ee59-a736-4efd-a10f-d5b47b6160c4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.072s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb5dfe7-6bc2-4373-a7c7-5868c6e94db3]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[962fa633-7d23-490f-a4e7-76bd90974644]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[db279310-cbb7-48d5-a6e4-22ad3b84ff5f]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab55a7aa-d5b3-47b4-8d29-22d363fdd3a3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc70804c-fcd0-42c6-91e4-f323f7d260a6]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260]
Aug 14 21:59:25 user nova-compute[73144]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2, portal: 172.16.0.220,3260] successful.
Aug 14 21:59:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc871012-d411-41ef-b756-0c516e0b06e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae2182-2d32-41d5-8802-fa49e54d1da5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] <== disconnect_volume: return (362ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-875af4ae-2e14-473b-9dae-45e1f63b3ddc req-f61b7861-f2f8-41bf-9f5b-ef6dd4ac291d service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-875af4ae-2e14-473b-9dae-45e1f63b3ddc req-f61b7861-f2f8-41bf-9f5b-ef6dd4ac291d service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-875af4ae-2e14-473b-9dae-45e1f63b3ddc req-f61b7861-f2f8-41bf-9f5b-ef6dd4ac291d service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-875af4ae-2e14-473b-9dae-45e1f63b3ddc req-f61b7861-f2f8-41bf-9f5b-ef6dd4ac291d service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-875af4ae-2e14-473b-9dae-45e1f63b3ddc req-f61b7861-f2f8-41bf-9f5b-ef6dd4ac291d service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:26 user nova-compute[73144]: WARNING nova.compute.manager [req-875af4ae-2e14-473b-9dae-45e1f63b3ddc req-f61b7861-f2f8-41bf-9f5b-ef6dd4ac291d service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state building and task_state spawning.
Aug 14 21:59:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'flavor' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ffa3e579-8b69-4803-86f0-fd595345efa7 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.872s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050368.582862, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] VM Resumed (Lifecycle Event)
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:59:28 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance spawned successfully.
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-53522b06-b19d-4901-9ca8-2a48a8d2bf48 req-a4b5d81f-6767-4b7c-9be8-92b2d5ebc8b2 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-53522b06-b19d-4901-9ca8-2a48a8d2bf48 req-a4b5d81f-6767-4b7c-9be8-92b2d5ebc8b2 service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-53522b06-b19d-4901-9ca8-2a48a8d2bf48 req-a4b5d81f-6767-4b7c-9be8-92b2d5ebc8b2 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-53522b06-b19d-4901-9ca8-2a48a8d2bf48 req-a4b5d81f-6767-4b7c-9be8-92b2d5ebc8b2 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-53522b06-b19d-4901-9ca8-2a48a8d2bf48 req-a4b5d81f-6767-4b7c-9be8-92b2d5ebc8b2 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:28 user nova-compute[73144]: WARNING nova.compute.manager [req-53522b06-b19d-4901-9ca8-2a48a8d2bf48 req-a4b5d81f-6767-4b7c-9be8-92b2d5ebc8b2 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state building and task_state spawning.
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050368.5847354, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] VM Started (Lifecycle Event)
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:59:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:59:28 user nova-compute[73144]: INFO nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 14 21:59:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:28 user nova-compute[73144]: INFO nova.compute.manager [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Took 7.45 seconds to build instance.
Aug 14 21:59:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6229413a-011e-402d-9398-cf94d193e4d0 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.547s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-changed-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Refreshing instance network info cache due to event network-changed-83d55052-b49e-4993-906e-5b18b5819e95. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:59:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] Acquiring lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:59:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] Acquired lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:59:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Refreshing network info cache for port 83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050355.1552916, 89f447d4-22b3-42f7-8830-9facdce3412c => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:30 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] VM Stopped (Lifecycle Event)
Aug 14 21:59:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bd91a061-bdb4-41e9-89dc-06c146894dc3 None None] [instance: 89f447d4-22b3-42f7-8830-9facdce3412c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG nova.objects.instance [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'flavor' on Instance uuid 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updated VIF entry in instance network info cache for port 83d55052-b49e-4993-906e-5b18b5819e95. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG nova.network.neutron [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updating instance_info_cache with network_info: [{"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-75a7f18d-5bcd-4cd8-b2c5-69e17a2ad640 req-282b0906-87b7-4c12-91bb-c1b057e71a90 service nova] Releasing lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:30 user nova-compute[73144]: INFO nova.compute.manager [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Attaching volume b5005740-785f-4266-8f1b-35f4c428a99c to /dev/vdb
Aug 14 21:59:30 user nova-compute[73144]: DEBUG os_brick.utils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1753507c-9285-4f81-8a59-a61b4ef0954d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9425fa-696a-48bf-909a-743579d9af21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d5dc4-ec5a-4a46-9cfa-f9ca117416c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fe4d84-bcc2-48c9-864e-682f80fcf4d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:59:30 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:59:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a87cc6-0684-4536-9479-6a5c58be2b2f]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG os_brick.utils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:59:30 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updating existing volume attachment record: 1a591519-4033-4fdf-b86a-d053ffeb4bba {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:59:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:59:40 user nova-compute[73144]: INFO nova.compute.claims [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Claim successful on node user
Aug 14 21:59:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWMTikom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:59:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:59:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:59:40 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f32223-ac45-4953-8609-c77ed32f2b68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:59:40 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fba388-4b8b-4d52-83a1-e5b579cf02d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c] added
Aug 14 21:59:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6093e8b7-9011-483d-85f6-a9b61e959a36]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[45515c15-bc03-4f9b-85c5-50d4c04f1a8d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWMTikom {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWMTikom" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241dfd9-582e-42f2-99db-d9052f85e19f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWMTikom'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[51271953-6499-480a-90ef-bb1cf0eec587]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d1379-cc23-4ffc-ae05-cb5ae1433397]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec106ffa-4d51-427b-83b6-4d0eb9cf87ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260]
Aug 14 21:59:40 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260] successful.
Aug 14 21:59:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[063296a3-407a-491d-8a02-6c6f250c000f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3002e8c-e4f7-42db-93f4-13d4fb54ddeb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c (non-flash)
Aug 14 21:59:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:40 user nova-compute[73144]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c (non-flash)
Aug 14 21:59:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d03f887-0fdc-492b-8f1a-fa9131f5f85a]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWMTikom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:59:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.policy [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe8b1fc0405438c99d3edd956e103a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e45dfdc13e486e950f6bc8595bb8fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:59:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Creating image(s)
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "/opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk 1073741824" returned: 0 in 0.066s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26532336238653434', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532336238653434', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.objects.instance [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'flavor' on Instance uuid 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:59:41 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:59:41 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 21:59:41 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:59:41 user nova-compute[73144]:   <serial>b5005740-785f-4266-8f1b-35f4c428a99c</serial>
Aug 14 21:59:41 user nova-compute[73144]: </disk>
Aug 14 21:59:41 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Cannot resize image /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.objects.instance [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'migration_context' on Instance uuid 87c08427-5779-444e-a6d0-afdc7b5c96ca {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Ensure instance console log exists: /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Successfully created port: cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] No VIF found with MAC fa:16:3e:ca:44:4f, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:59:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86581104-0c75-47e2-b670-3f62e812b8a3 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.042s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Successfully updated port: cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received event network-changed-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Refreshing instance network info cache due to event network-changed-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] Acquiring lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Updating instance_info_cache with network_info: [{"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Instance network_info: |[{"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] Acquired lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.neutron [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Refreshing network info cache for port cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Start _get_guest_xml network_info=[{"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:59:43 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:59:43 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-204822568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-204822568',id=34,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-7j7soadp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:59:41Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=87c08427-5779-444e-a6d0-afdc7b5c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e6:ef,bridge_name='br-int',has_traffic_filtering=True,id=cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc77aeb-ee') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.objects.instance [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'pci_devices' on Instance uuid 87c08427-5779-444e-a6d0-afdc7b5c96ca {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:59:43 user nova-compute[73144]:   <uuid>87c08427-5779-444e-a6d0-afdc7b5c96ca</uuid>
Aug 14 21:59:43 user nova-compute[73144]:   <name>instance-00000022</name>
Aug 14 21:59:43 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 21:59:43 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 21:59:43 user nova-compute[73144]:   <metadata>
Aug 14 21:59:43 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:59:43 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 21:59:43 user nova-compute[73144]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-204822568</nova:name>
Aug 14 21:59:43 user nova-compute[73144]:       <nova:creationTime>2023-08-14 21:59:43</nova:creationTime>
Aug 14 21:59:43 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 21:59:43 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 21:59:43 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 21:59:43 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 21:59:43 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:59:43 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:59:43 user nova-compute[73144]:       </nova:flavor>
Aug 14 21:59:43 user nova-compute[73144]:       <nova:owner>
Aug 14 21:59:43 user nova-compute[73144]:         <nova:user uuid="cfe8b1fc0405438c99d3edd956e103a4">tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member</nova:user>
Aug 14 21:59:43 user nova-compute[73144]:         <nova:project uuid="59e45dfdc13e486e950f6bc8595bb8fa">tempest-ServerBootFromVolumeStableRescueTest-847208830</nova:project>
Aug 14 21:59:43 user nova-compute[73144]:       </nova:owner>
Aug 14 21:59:43 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 21:59:43 user nova-compute[73144]:       <nova:ports>
Aug 14 21:59:43 user nova-compute[73144]:         <nova:port uuid="cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d">
Aug 14 21:59:43 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 21:59:43 user nova-compute[73144]:         </nova:port>
Aug 14 21:59:43 user nova-compute[73144]:       </nova:ports>
Aug 14 21:59:43 user nova-compute[73144]:     </nova:instance>
Aug 14 21:59:43 user nova-compute[73144]:   </metadata>
Aug 14 21:59:43 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 21:59:43 user nova-compute[73144]:     <system>
Aug 14 21:59:43 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:59:43 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:59:43 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 21:59:43 user nova-compute[73144]:       <entry name="serial">87c08427-5779-444e-a6d0-afdc7b5c96ca</entry>
Aug 14 21:59:43 user nova-compute[73144]:       <entry name="uuid">87c08427-5779-444e-a6d0-afdc7b5c96ca</entry>
Aug 14 21:59:43 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:59:43 user nova-compute[73144]:     </system>
Aug 14 21:59:43 user nova-compute[73144]:   </sysinfo>
Aug 14 21:59:43 user nova-compute[73144]:   <os>
Aug 14 21:59:43 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:59:43 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 21:59:43 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 21:59:43 user nova-compute[73144]:   </os>
Aug 14 21:59:43 user nova-compute[73144]:   <features>
Aug 14 21:59:43 user nova-compute[73144]:     <acpi/>
Aug 14 21:59:43 user nova-compute[73144]:     <apic/>
Aug 14 21:59:43 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 21:59:43 user nova-compute[73144]:   </features>
Aug 14 21:59:43 user nova-compute[73144]:   <clock offset="utc">
Aug 14 21:59:43 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:59:43 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:59:43 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 21:59:43 user nova-compute[73144]:   </clock>
Aug 14 21:59:43 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 21:59:43 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 21:59:43 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:59:43 user nova-compute[73144]:   </cpu>
Aug 14 21:59:43 user nova-compute[73144]:   <devices>
Aug 14 21:59:43 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 21:59:43 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:59:43 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk"/>
Aug 14 21:59:43 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 21:59:43 user nova-compute[73144]:     </disk>
Aug 14 21:59:43 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 21:59:43 user nova-compute[73144]:       <mac address="fa:16:3e:9a:e6:ef"/>
Aug 14 21:59:43 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:59:43 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 21:59:43 user nova-compute[73144]:       <target dev="tapcfc77aeb-ee"/>
Aug 14 21:59:43 user nova-compute[73144]:     </interface>
Aug 14 21:59:43 user nova-compute[73144]:     <serial type="pty">
Aug 14 21:59:43 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/console.log" append="off"/>
Aug 14 21:59:43 user nova-compute[73144]:     </serial>
Aug 14 21:59:43 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:59:43 user nova-compute[73144]:     <video>
Aug 14 21:59:43 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 21:59:43 user nova-compute[73144]:     </video>
Aug 14 21:59:43 user nova-compute[73144]:     <rng model="virtio">
Aug 14 21:59:43 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:59:43 user nova-compute[73144]:     </rng>
Aug 14 21:59:43 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:59:43 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 21:59:43 user nova-compute[73144]:       <stats period="10"/>
Aug 14 21:59:43 user nova-compute[73144]:     </memballoon>
Aug 14 21:59:43 user nova-compute[73144]:   </devices>
Aug 14 21:59:43 user nova-compute[73144]: </domain>
Aug 14 21:59:43 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-204822568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-204822568',id=34,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-7j7soadp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:59:41Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=87c08427-5779-444e-a6d0-afdc7b5c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e6:ef,bridge_name='br-int',has_traffic_filtering=True,id=cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc77aeb-ee') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG os_vif [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e6:ef,bridge_name='br-int',has_traffic_filtering=True,id=cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc77aeb-ee') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfc77aeb-ee, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfc77aeb-ee, col_values=(('external_ids', {'iface-id': 'cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:e6:ef', 'vm-uuid': '87c08427-5779-444e-a6d0-afdc7b5c96ca'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:43 user nova-compute[73144]: INFO os_vif [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e6:ef,bridge_name='br-int',has_traffic_filtering=True,id=cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc77aeb-ee')
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:59:43 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No VIF found with MAC fa:16:3e:9a:e6:ef, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:59:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Updated VIF entry in instance network info cache for port cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:59:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Updating instance_info_cache with network_info: [{"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:59:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c176ede4-5753-45cc-a036-12222e418741 req-e95badd7-2053-44e0-b400-9a91f8e0839b service nova] Releasing lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:59:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:44 user nova-compute[73144]: INFO nova.compute.manager [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Detaching volume b5005740-785f-4266-8f1b-35f4c428a99c
Aug 14 21:59:45 user nova-compute[73144]: INFO nova.virt.block_device [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Attempting to driver detach volume b5005740-785f-4266-8f1b-35f4c428a99c from mountpoint /dev/vdb
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Attempting to detach device vdb from instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:59:45 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:59:45 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 21:59:45 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:59:45 user nova-compute[73144]:   <serial>b5005740-785f-4266-8f1b-35f4c428a99c</serial>
Aug 14 21:59:45 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:59:45 user nova-compute[73144]: </disk>
Aug 14 21:59:45 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:59:45 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully detached device vdb from instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 from the persistent domain config.
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:59:45 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:59:45 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 21:59:45 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:59:45 user nova-compute[73144]:   <serial>b5005740-785f-4266-8f1b-35f4c428a99c</serial>
Aug 14 21:59:45 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:59:45 user nova-compute[73144]: </disk>
Aug 14 21:59:45 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf7e7ac6-80c3-4526-983c-8c29e5389e08 req-a55ef419-d150-4f82-83ac-a096c36c17d7 service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received event network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf7e7ac6-80c3-4526-983c-8c29e5389e08 req-a55ef419-d150-4f82-83ac-a096c36c17d7 service nova] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf7e7ac6-80c3-4526-983c-8c29e5389e08 req-a55ef419-d150-4f82-83ac-a096c36c17d7 service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf7e7ac6-80c3-4526-983c-8c29e5389e08 req-a55ef419-d150-4f82-83ac-a096c36c17d7 service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf7e7ac6-80c3-4526-983c-8c29e5389e08 req-a55ef419-d150-4f82-83ac-a096c36c17d7 service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] No waiting events found dispatching network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:45 user nova-compute[73144]: WARNING nova.compute.manager [req-cf7e7ac6-80c3-4526-983c-8c29e5389e08 req-a55ef419-d150-4f82-83ac-a096c36c17d7 service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received unexpected event network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d for instance with vm_state building and task_state spawning.
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050385.624463, 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:59:45 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully detached device vdb from instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 from the live domain config.
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWMTikom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:59:45 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[514af775-27d6-4f30-a61a-989a43282395]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a99eb61-54ad-4b7b-8cae-27388e972cf0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:45 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:45 user nova-compute[73144]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c (non-flash)
Aug 14 21:59:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 21:59:45 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 21:59:45 user nova-compute[73144]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c (non-flash)
Aug 14 21:59:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa15865ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d58b6-cfb8-4c4b-a81d-29803ff66c5b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c593ab-65ab-4e9e-8e0f-818139203792]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[10999623-d3bd-441c-846e-f3a438e028df]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdf1ffe-17b1-492d-aeab-563ff533f836]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e13e79d-6dd0-45d9-8fae-010ab4b1f27f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec0237-15f9-4c3a-9b3a-020ff58c1d66]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260]
Aug 14 21:59:45 user nova-compute[73144]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c, portal: 172.16.0.220,3260] successful.
Aug 14 21:59:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5005740-785f-4266-8f1b-35f4c428a99c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1e8779-fe58-4370-bde6-d00e234b0a86]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] <== disconnect_volume: return (318ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:59:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:59:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:46 user nova-compute[73144]: DEBUG nova.objects.instance [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'flavor' on Instance uuid 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:59:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8b417256-fe95-4bb9-abad-08a36f3251f1 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.910s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-73483b77-b3ff-48a5-97f3-57b7a745261d req-5b00f3c3-1dac-4948-831d-92d992ddb329 service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received event network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-73483b77-b3ff-48a5-97f3-57b7a745261d req-5b00f3c3-1dac-4948-831d-92d992ddb329 service nova] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-73483b77-b3ff-48a5-97f3-57b7a745261d req-5b00f3c3-1dac-4948-831d-92d992ddb329 service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-73483b77-b3ff-48a5-97f3-57b7a745261d req-5b00f3c3-1dac-4948-831d-92d992ddb329 service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-73483b77-b3ff-48a5-97f3-57b7a745261d req-5b00f3c3-1dac-4948-831d-92d992ddb329 service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] No waiting events found dispatching network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:59:47 user nova-compute[73144]: WARNING nova.compute.manager [req-73483b77-b3ff-48a5-97f3-57b7a745261d req-5b00f3c3-1dac-4948-831d-92d992ddb329 service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received unexpected event network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d for instance with vm_state building and task_state spawning.
Aug 14 21:59:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050387.9557548, 87c08427-5779-444e-a6d0-afdc7b5c96ca => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:47 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] VM Resumed (Lifecycle Event)
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:59:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Instance spawned successfully.
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:59:48 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:59:48 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050387.9590151, 87c08427-5779-444e-a6d0-afdc7b5c96ca => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:59:48 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] VM Started (Lifecycle Event)
Aug 14 21:59:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:59:48 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:59:48 user nova-compute[73144]: INFO nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 14 21:59:48 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:59:48 user nova-compute[73144]: INFO nova.compute.manager [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Took 7.85 seconds to build instance.
Aug 14 21:59:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a63fbea5-ca60-41d4-ad0d-c8f8038318cc tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.966s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:59:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:59:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:02 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:05 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:00:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:07 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:00:07 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:12 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:00:12 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7190MB free_disk=25.044219970703125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Applying migration context for instance 37ba2c90-f471-4c24-ada2-084734722610 as it has an incoming, in-progress migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd. Migration status is finished {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 22:00:12 user nova-compute[73144]: INFO nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating resource usage from migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance db61b783-50d7-4304-a031-f9fb11069ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37ba2c90-f471-4c24-ada2-084734722610 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:00:12 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:00:13 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:00:13 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:00:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:00:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:15 user nova-compute[73144]: INFO nova.compute.manager [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Terminating instance
Aug 14 22:00:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:00:15 user nova-compute[73144]: INFO nova.compute.claims [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Claim successful on node user
Aug 14 22:00:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Instance destroyed successfully.
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'resources' on Instance uuid db61b783-50d7-4304-a031-f9fb11069ef1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T21:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1737547142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1737547142',id=24,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH38bkufm/qGiYeooM925P2qMy5I531AMDQ4MiSpll0SMC2jTiN6Xml+/7KbitUtc/eB/HVnvu5PMqygkBkSM2zwNVpjUWVIPJ0s517qp32qOXrsZbOYDoSHGkjfB3PqQ==',key_name='tempest-keypair-1826093270',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-gir6zm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=db61b783-50d7-4304-a031-f9fb11069ef1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "address": "fa:16:3e:93:8d:d6", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39a4a57-be", "ovs_interfaceid": "f39a4a57-be14-4d33-b6d0-f6e8469b9d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG os_vif [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf39a4a57-be, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:00:16 user nova-compute[73144]: INFO os_vif [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f39a4a57-be14-4d33-b6d0-f6e8469b9d55,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39a4a57-be')
Aug 14 22:00:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Deleting instance files /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1_del
Aug 14 22:00:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Deletion of /opt/stack/data/nova/instances/db61b783-50d7-4304-a031-f9fb11069ef1_del complete
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:00:16 user nova-compute[73144]: INFO nova.compute.manager [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 22:00:16 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:00:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:00:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Creating image(s)
Aug 14 22:00:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "/opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "/opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "a2231bdb465b22c943a5dfd7a74020acc1036d20" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "a2231bdb465b22c943a5dfd7a74020acc1036d20" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.policy [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5b646bc914e419e987ebada26905446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1319de1ca444198f3edddf26ce07b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a5c61e1-8dea-4457-b425-aa6c0e3dfd37 req-1cf2fc11-1d71-4f59-b47c-4ce0c9dd205a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-unplugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a5c61e1-8dea-4457-b425-aa6c0e3dfd37 req-1cf2fc11-1d71-4f59-b47c-4ce0c9dd205a service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a5c61e1-8dea-4457-b425-aa6c0e3dfd37 req-1cf2fc11-1d71-4f59-b47c-4ce0c9dd205a service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5a5c61e1-8dea-4457-b425-aa6c0e3dfd37 req-1cf2fc11-1d71-4f59-b47c-4ce0c9dd205a service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a5c61e1-8dea-4457-b425-aa6c0e3dfd37 req-1cf2fc11-1d71-4f59-b47c-4ce0c9dd205a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-unplugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-5a5c61e1-8dea-4457-b425-aa6c0e3dfd37 req-1cf2fc11-1d71-4f59-b47c-4ce0c9dd205a service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-unplugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.part --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.virt.images [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] 943601c3-7bf1-4cb6-86ae-bc63be3769d5 was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.part /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.part /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.converted" returned: 0 in 0.305s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "a2231bdb465b22c943a5dfd7a74020acc1036d20" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.115s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json" returned: 0 in 0.206s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "a2231bdb465b22c943a5dfd7a74020acc1036d20" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "a2231bdb465b22c943a5dfd7a74020acc1036d20" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:18 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Took 1.59 seconds to deallocate network for instance.
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20,backing_fmt=raw /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20,backing_fmt=raw /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk 1073741824" returned: 0 in 0.058s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "a2231bdb465b22c943a5dfd7a74020acc1036d20" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json" returned: 0 in 0.219s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updating instance_info_cache with network_info: [{"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Successfully created port: e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Cannot resize image /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.objects.instance [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'migration_context' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Ensure instance console log exists: /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.622s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:18 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:00:18 user nova-compute[73144]: INFO nova.compute.claims [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Claim successful on node user
Aug 14 22:00:18 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Deleted allocations for instance db61b783-50d7-4304-a031-f9fb11069ef1
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a24aa2e0-4def-4b8c-b129-7c4b3625bbbc tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "db61b783-50d7-4304-a031-f9fb11069ef1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.537s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b46770a-c7ea-4470-834d-7c386888082d req-cef0f7fb-4b10-41a2-9d3d-203c513d4b15 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b46770a-c7ea-4470-834d-7c386888082d req-cef0f7fb-4b10-41a2-9d3d-203c513d4b15 service nova] Acquiring lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b46770a-c7ea-4470-834d-7c386888082d req-cef0f7fb-4b10-41a2-9d3d-203c513d4b15 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5b46770a-c7ea-4470-834d-7c386888082d req-cef0f7fb-4b10-41a2-9d3d-203c513d4b15 service nova] Lock "db61b783-50d7-4304-a031-f9fb11069ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b46770a-c7ea-4470-834d-7c386888082d req-cef0f7fb-4b10-41a2-9d3d-203c513d4b15 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] No waiting events found dispatching network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:19 user nova-compute[73144]: WARNING nova.compute.manager [req-5b46770a-c7ea-4470-834d-7c386888082d req-cef0f7fb-4b10-41a2-9d3d-203c513d4b15 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received unexpected event network-vif-plugged-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 for instance with vm_state deleted and task_state None.
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.manager [req-5b46770a-c7ea-4470-834d-7c386888082d req-cef0f7fb-4b10-41a2-9d3d-203c513d4b15 service nova] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Received event network-vif-deleted-f39a4a57-be14-4d33-b6d0-f6e8469b9d55 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:00:19 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:00:19 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Creating image(s)
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "/opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "/opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG nova.policy [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '388ab65745f84dee929d1a4a06ec3b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aedc6ea9da7460f920eab6f6affeb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.198s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Successfully updated port: e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquired lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk 1073741824" returned: 0 in 0.125s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing instance network info cache due to event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] Acquiring lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Releasing lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance network_info: |[{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Cannot resize image /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lazy-loading 'migration_context' on Instance uuid 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] Acquired lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.neutron [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Start _get_guest_xml network_info=[{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:00:12Z,direct_url=<?>,disk_format='qcow2',id=943601c3-7bf1-4cb6-86ae-bc63be3769d5,min_disk=0,min_ram=0,name='tempest-scenario-img--10012582',owner='6d1319de1ca444198f3edddf26ce07b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:00:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '943601c3-7bf1-4cb6-86ae-bc63be3769d5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Ensure instance console log exists: /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:00:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:00:12Z,direct_url=<?>,disk_format='qcow2',id=943601c3-7bf1-4cb6-86ae-bc63be3769d5,min_disk=0,min_ram=0,name='tempest-scenario-img--10012582',owner='6d1319de1ca444198f3edddf26ce07b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:00:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872334805',display_name='tempest-TestMinimumBasicScenario-server-1872334805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872334805',id=35,image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1HtMIZDB5L2KiUNfOZ1iQNQmfkn3XwTU3u05v5z3hwMkd5vEOICMxCq0xcnImKICtaZ9ksOizbJ9rvRBHmEIzz+elqoLnyXq7QW2fSP+wbW77K6e23dr7hFN1osHAQUQ==',key_name='tempest-TestMinimumBasicScenario-24525501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-wwyngt8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:00:17Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cbc94659-f76f-4b53-903b-60f59b0dfc55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.objects.instance [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'pci_devices' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:00:20 user nova-compute[73144]:   <uuid>cbc94659-f76f-4b53-903b-60f59b0dfc55</uuid>
Aug 14 22:00:20 user nova-compute[73144]:   <name>instance-00000023</name>
Aug 14 22:00:20 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:00:20 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:00:20 user nova-compute[73144]:   <metadata>
Aug 14 22:00:20 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:00:20 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:00:20 user nova-compute[73144]:       <nova:name>tempest-TestMinimumBasicScenario-server-1872334805</nova:name>
Aug 14 22:00:20 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:00:20</nova:creationTime>
Aug 14 22:00:20 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:00:20 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:00:20 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:00:20 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:00:20 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:00:20 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:00:20 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:00:20 user nova-compute[73144]:       <nova:owner>
Aug 14 22:00:20 user nova-compute[73144]:         <nova:user uuid="f5b646bc914e419e987ebada26905446">tempest-TestMinimumBasicScenario-1966855885-project-member</nova:user>
Aug 14 22:00:20 user nova-compute[73144]:         <nova:project uuid="6d1319de1ca444198f3edddf26ce07b1">tempest-TestMinimumBasicScenario-1966855885</nova:project>
Aug 14 22:00:20 user nova-compute[73144]:       </nova:owner>
Aug 14 22:00:20 user nova-compute[73144]:       <nova:root type="image" uuid="943601c3-7bf1-4cb6-86ae-bc63be3769d5"/>
Aug 14 22:00:20 user nova-compute[73144]:       <nova:ports>
Aug 14 22:00:20 user nova-compute[73144]:         <nova:port uuid="e11dc58f-a416-43a7-b0b9-73ee1dd7382d">
Aug 14 22:00:20 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 22:00:20 user nova-compute[73144]:         </nova:port>
Aug 14 22:00:20 user nova-compute[73144]:       </nova:ports>
Aug 14 22:00:20 user nova-compute[73144]:     </nova:instance>
Aug 14 22:00:20 user nova-compute[73144]:   </metadata>
Aug 14 22:00:20 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:00:20 user nova-compute[73144]:     <system>
Aug 14 22:00:20 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:00:20 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:00:20 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:00:20 user nova-compute[73144]:       <entry name="serial">cbc94659-f76f-4b53-903b-60f59b0dfc55</entry>
Aug 14 22:00:20 user nova-compute[73144]:       <entry name="uuid">cbc94659-f76f-4b53-903b-60f59b0dfc55</entry>
Aug 14 22:00:20 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:00:20 user nova-compute[73144]:     </system>
Aug 14 22:00:20 user nova-compute[73144]:   </sysinfo>
Aug 14 22:00:20 user nova-compute[73144]:   <os>
Aug 14 22:00:20 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:00:20 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:00:20 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:00:20 user nova-compute[73144]:   </os>
Aug 14 22:00:20 user nova-compute[73144]:   <features>
Aug 14 22:00:20 user nova-compute[73144]:     <acpi/>
Aug 14 22:00:20 user nova-compute[73144]:     <apic/>
Aug 14 22:00:20 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:00:20 user nova-compute[73144]:   </features>
Aug 14 22:00:20 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:00:20 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:00:20 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:00:20 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:00:20 user nova-compute[73144]:   </clock>
Aug 14 22:00:20 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:00:20 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:00:20 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:00:20 user nova-compute[73144]:   </cpu>
Aug 14 22:00:20 user nova-compute[73144]:   <devices>
Aug 14 22:00:20 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:00:20 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:00:20 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk"/>
Aug 14 22:00:20 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:00:20 user nova-compute[73144]:     </disk>
Aug 14 22:00:20 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:00:20 user nova-compute[73144]:       <mac address="fa:16:3e:81:41:b2"/>
Aug 14 22:00:20 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:00:20 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:00:20 user nova-compute[73144]:       <target dev="tape11dc58f-a4"/>
Aug 14 22:00:20 user nova-compute[73144]:     </interface>
Aug 14 22:00:20 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:00:20 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/console.log" append="off"/>
Aug 14 22:00:20 user nova-compute[73144]:     </serial>
Aug 14 22:00:20 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:00:20 user nova-compute[73144]:     <video>
Aug 14 22:00:20 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:00:20 user nova-compute[73144]:     </video>
Aug 14 22:00:20 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:00:20 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:00:20 user nova-compute[73144]:     </rng>
Aug 14 22:00:20 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:00:20 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:00:20 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:00:20 user nova-compute[73144]:     </memballoon>
Aug 14 22:00:20 user nova-compute[73144]:   </devices>
Aug 14 22:00:20 user nova-compute[73144]: </domain>
Aug 14 22:00:20 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872334805',display_name='tempest-TestMinimumBasicScenario-server-1872334805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872334805',id=35,image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1HtMIZDB5L2KiUNfOZ1iQNQmfkn3XwTU3u05v5z3hwMkd5vEOICMxCq0xcnImKICtaZ9ksOizbJ9rvRBHmEIzz+elqoLnyXq7QW2fSP+wbW77K6e23dr7hFN1osHAQUQ==',key_name='tempest-TestMinimumBasicScenario-24525501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-wwyngt8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:00:17Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cbc94659-f76f-4b53-903b-60f59b0dfc55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG os_vif [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape11dc58f-a4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape11dc58f-a4, col_values=(('external_ids', {'iface-id': 'e11dc58f-a416-43a7-b0b9-73ee1dd7382d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:41:b2', 'vm-uuid': 'cbc94659-f76f-4b53-903b-60f59b0dfc55'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:20 user nova-compute[73144]: INFO os_vif [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4')
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:00:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No VIF found with MAC fa:16:3e:81:41:b2, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Successfully created port: 9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updated VIF entry in instance network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dd9fc4d8-f016-4883-b17e-0c9f1286089d req-b3fdf0e9-cf04-440b-8d52-d746853d177b service nova] Releasing lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Successfully updated port: 9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "refresh_cache-7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquired lock "refresh_cache-7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received event network-changed-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Refreshing instance network info cache due to event network-changed-9157e5b9-feb1-4474-b03a-3cd7ee34bf70. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:00:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] Acquiring lock "refresh_cache-7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Updating instance_info_cache with network_info: [{"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Releasing lock "refresh_cache-7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Instance network_info: |[{"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] Acquired lock "refresh_cache-7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.network.neutron [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Refreshing network info cache for port 9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Start _get_guest_xml network_info=[{"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:00:22 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:00:22 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-477580037',display_name='tempest-VolumesNegativeTest-instance-477580037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-477580037',id=36,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedc6ea9da7460f920eab6f6affeb92',ramdisk_id='',reservation_id='r-0ps960cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2122835154',owner_user_name='tempest-VolumesNegativeTest-2122835154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:00:20Z,user_data=None,user_id='388ab65745f84dee929d1a4a06ec3b31',uuid=7d01cc08-97b5-415b-a1ad-a6121fbcf4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Converting VIF {"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cd:a3,bridge_name='br-int',has_traffic_filtering=True,id=9157e5b9-feb1-4474-b03a-3cd7ee34bf70,network=Network(c2f88d6f-f5f4-4a73-8e22-0e907bb9a134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9157e5b9-fe') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:00:22 user nova-compute[73144]:   <uuid>7d01cc08-97b5-415b-a1ad-a6121fbcf4b2</uuid>
Aug 14 22:00:22 user nova-compute[73144]:   <name>instance-00000024</name>
Aug 14 22:00:22 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:00:22 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:00:22 user nova-compute[73144]:   <metadata>
Aug 14 22:00:22 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:00:22 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:00:22 user nova-compute[73144]:       <nova:name>tempest-VolumesNegativeTest-instance-477580037</nova:name>
Aug 14 22:00:22 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:00:22</nova:creationTime>
Aug 14 22:00:22 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:00:22 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:00:22 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:00:22 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:00:22 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:00:22 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:00:22 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:00:22 user nova-compute[73144]:       <nova:owner>
Aug 14 22:00:22 user nova-compute[73144]:         <nova:user uuid="388ab65745f84dee929d1a4a06ec3b31">tempest-VolumesNegativeTest-2122835154-project-member</nova:user>
Aug 14 22:00:22 user nova-compute[73144]:         <nova:project uuid="0aedc6ea9da7460f920eab6f6affeb92">tempest-VolumesNegativeTest-2122835154</nova:project>
Aug 14 22:00:22 user nova-compute[73144]:       </nova:owner>
Aug 14 22:00:22 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:00:22 user nova-compute[73144]:       <nova:ports>
Aug 14 22:00:22 user nova-compute[73144]:         <nova:port uuid="9157e5b9-feb1-4474-b03a-3cd7ee34bf70">
Aug 14 22:00:22 user nova-compute[73144]:           <nova:ip type="fixed" address="192.168.233.3" ipVersion="4"/>
Aug 14 22:00:22 user nova-compute[73144]:         </nova:port>
Aug 14 22:00:22 user nova-compute[73144]:       </nova:ports>
Aug 14 22:00:22 user nova-compute[73144]:     </nova:instance>
Aug 14 22:00:22 user nova-compute[73144]:   </metadata>
Aug 14 22:00:22 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:00:22 user nova-compute[73144]:     <system>
Aug 14 22:00:22 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:00:22 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:00:22 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:00:22 user nova-compute[73144]:       <entry name="serial">7d01cc08-97b5-415b-a1ad-a6121fbcf4b2</entry>
Aug 14 22:00:22 user nova-compute[73144]:       <entry name="uuid">7d01cc08-97b5-415b-a1ad-a6121fbcf4b2</entry>
Aug 14 22:00:22 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:00:22 user nova-compute[73144]:     </system>
Aug 14 22:00:22 user nova-compute[73144]:   </sysinfo>
Aug 14 22:00:22 user nova-compute[73144]:   <os>
Aug 14 22:00:22 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:00:22 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:00:22 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:00:22 user nova-compute[73144]:   </os>
Aug 14 22:00:22 user nova-compute[73144]:   <features>
Aug 14 22:00:22 user nova-compute[73144]:     <acpi/>
Aug 14 22:00:22 user nova-compute[73144]:     <apic/>
Aug 14 22:00:22 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:00:22 user nova-compute[73144]:   </features>
Aug 14 22:00:22 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:00:22 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:00:22 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:00:22 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:00:22 user nova-compute[73144]:   </clock>
Aug 14 22:00:22 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:00:22 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:00:22 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:00:22 user nova-compute[73144]:   </cpu>
Aug 14 22:00:22 user nova-compute[73144]:   <devices>
Aug 14 22:00:22 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:00:22 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:00:22 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk"/>
Aug 14 22:00:22 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:00:22 user nova-compute[73144]:     </disk>
Aug 14 22:00:22 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:00:22 user nova-compute[73144]:       <mac address="fa:16:3e:f6:cd:a3"/>
Aug 14 22:00:22 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:00:22 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:00:22 user nova-compute[73144]:       <target dev="tap9157e5b9-fe"/>
Aug 14 22:00:22 user nova-compute[73144]:     </interface>
Aug 14 22:00:22 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:00:22 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/console.log" append="off"/>
Aug 14 22:00:22 user nova-compute[73144]:     </serial>
Aug 14 22:00:22 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:00:22 user nova-compute[73144]:     <video>
Aug 14 22:00:22 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:00:22 user nova-compute[73144]:     </video>
Aug 14 22:00:22 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:00:22 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:00:22 user nova-compute[73144]:     </rng>
Aug 14 22:00:22 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:00:22 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:00:22 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:00:22 user nova-compute[73144]:     </memballoon>
Aug 14 22:00:22 user nova-compute[73144]:   </devices>
Aug 14 22:00:22 user nova-compute[73144]: </domain>
Aug 14 22:00:22 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-477580037',display_name='tempest-VolumesNegativeTest-instance-477580037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-477580037',id=36,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedc6ea9da7460f920eab6f6affeb92',ramdisk_id='',reservation_id='r-0ps960cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2122835154',owner_user_name='tempest-VolumesNegativeTest-2122835154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:00:20Z,user_data=None,user_id='388ab65745f84dee929d1a4a06ec3b31',uuid=7d01cc08-97b5-415b-a1ad-a6121fbcf4b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Converting VIF {"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cd:a3,bridge_name='br-int',has_traffic_filtering=True,id=9157e5b9-feb1-4474-b03a-3cd7ee34bf70,network=Network(c2f88d6f-f5f4-4a73-8e22-0e907bb9a134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9157e5b9-fe') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG os_vif [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cd:a3,bridge_name='br-int',has_traffic_filtering=True,id=9157e5b9-feb1-4474-b03a-3cd7ee34bf70,network=Network(c2f88d6f-f5f4-4a73-8e22-0e907bb9a134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9157e5b9-fe') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9157e5b9-fe, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9157e5b9-fe, col_values=(('external_ids', {'iface-id': '9157e5b9-feb1-4474-b03a-3cd7ee34bf70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:cd:a3', 'vm-uuid': '7d01cc08-97b5-415b-a1ad-a6121fbcf4b2'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: INFO os_vif [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cd:a3,bridge_name='br-int',has_traffic_filtering=True,id=9157e5b9-feb1-4474-b03a-3cd7ee34bf70,network=Network(c2f88d6f-f5f4-4a73-8e22-0e907bb9a134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9157e5b9-fe')
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-63a3666d-acee-4e86-8361-f0c3791e420f req-67bedaf6-c2ad-4273-85d1-ba3fc423c457 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-63a3666d-acee-4e86-8361-f0c3791e420f req-67bedaf6-c2ad-4273-85d1-ba3fc423c457 service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-63a3666d-acee-4e86-8361-f0c3791e420f req-67bedaf6-c2ad-4273-85d1-ba3fc423c457 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-63a3666d-acee-4e86-8361-f0c3791e420f req-67bedaf6-c2ad-4273-85d1-ba3fc423c457 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-63a3666d-acee-4e86-8361-f0c3791e420f req-67bedaf6-c2ad-4273-85d1-ba3fc423c457 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:22 user nova-compute[73144]: WARNING nova.compute.manager [req-63a3666d-acee-4e86-8361-f0c3791e420f req-67bedaf6-c2ad-4273-85d1-ba3fc423c457 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received unexpected event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with vm_state building and task_state spawning.
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] No VIF found with MAC fa:16:3e:f6:cd:a3, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Updated VIF entry in instance network info cache for port 9157e5b9-feb1-4474-b03a-3cd7ee34bf70. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:00:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Updating instance_info_cache with network_info: [{"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-144a6437-630c-4a07-ad4e-3087c7a6de31 req-cbb390c3-f153-466c-ad5d-662c9c579635 service nova] Releasing lock "refresh_cache-7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6fc7f11-d497-4bc6-b2bc-1b7d233af5c7 req-15d7cdcb-b790-480e-9bb7-23508296d3ef service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received event network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6fc7f11-d497-4bc6-b2bc-1b7d233af5c7 req-15d7cdcb-b790-480e-9bb7-23508296d3ef service nova] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6fc7f11-d497-4bc6-b2bc-1b7d233af5c7 req-15d7cdcb-b790-480e-9bb7-23508296d3ef service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6fc7f11-d497-4bc6-b2bc-1b7d233af5c7 req-15d7cdcb-b790-480e-9bb7-23508296d3ef service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6fc7f11-d497-4bc6-b2bc-1b7d233af5c7 req-15d7cdcb-b790-480e-9bb7-23508296d3ef service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] No waiting events found dispatching network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:24 user nova-compute[73144]: WARNING nova.compute.manager [req-a6fc7f11-d497-4bc6-b2bc-1b7d233af5c7 req-15d7cdcb-b790-480e-9bb7-23508296d3ef service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received unexpected event network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 for instance with vm_state building and task_state spawning.
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050424.6566792, cbc94659-f76f-4b53-903b-60f59b0dfc55 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:00:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] VM Resumed (Lifecycle Event)
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:00:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance spawned successfully.
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:00:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050424.6630707, cbc94659-f76f-4b53-903b-60f59b0dfc55 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:00:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] VM Started (Lifecycle Event)
Aug 14 22:00:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-889fb34d-4605-4d19-85de-bebedb5d32bc req-70630507-8d8c-46b3-8778-8549fe60f95c service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-889fb34d-4605-4d19-85de-bebedb5d32bc req-70630507-8d8c-46b3-8778-8549fe60f95c service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-889fb34d-4605-4d19-85de-bebedb5d32bc req-70630507-8d8c-46b3-8778-8549fe60f95c service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-889fb34d-4605-4d19-85de-bebedb5d32bc req-70630507-8d8c-46b3-8778-8549fe60f95c service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-889fb34d-4605-4d19-85de-bebedb5d32bc req-70630507-8d8c-46b3-8778-8549fe60f95c service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:24 user nova-compute[73144]: WARNING nova.compute.manager [req-889fb34d-4605-4d19-85de-bebedb5d32bc req-70630507-8d8c-46b3-8778-8549fe60f95c service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received unexpected event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with vm_state building and task_state spawning.
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:00:24 user nova-compute[73144]: INFO nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Took 8.17 seconds to spawn the instance on the hypervisor.
Aug 14 22:00:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:00:24 user nova-compute[73144]: INFO nova.compute.manager [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Took 9.17 seconds to build instance.
Aug 14 22:00:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6edab42d-fccb-4caf-9ef9-1bf86c830dce tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.296s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-d4b7deaf-edf7-411a-8a93-ce571fe1f97b req-bcbf2df1-8a7b-46dd-a558-e38a96865521 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received event network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d4b7deaf-edf7-411a-8a93-ce571fe1f97b req-bcbf2df1-8a7b-46dd-a558-e38a96865521 service nova] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d4b7deaf-edf7-411a-8a93-ce571fe1f97b req-bcbf2df1-8a7b-46dd-a558-e38a96865521 service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d4b7deaf-edf7-411a-8a93-ce571fe1f97b req-bcbf2df1-8a7b-46dd-a558-e38a96865521 service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-d4b7deaf-edf7-411a-8a93-ce571fe1f97b req-bcbf2df1-8a7b-46dd-a558-e38a96865521 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] No waiting events found dispatching network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:26 user nova-compute[73144]: WARNING nova.compute.manager [req-d4b7deaf-edf7-411a-8a93-ce571fe1f97b req-bcbf2df1-8a7b-46dd-a558-e38a96865521 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received unexpected event network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 for instance with vm_state building and task_state spawning.
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050426.5123177, 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:00:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] VM Resumed (Lifecycle Event)
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:00:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Instance spawned successfully.
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:00:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050426.5155287, 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:00:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] VM Started (Lifecycle Event)
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:00:26 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:00:26 user nova-compute[73144]: INFO nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 14 22:00:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:26 user nova-compute[73144]: INFO nova.compute.manager [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Took 8.09 seconds to build instance.
Aug 14 22:00:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0aa9ee26-d2e2-416c-9975-60153124def6 tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.189s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:31 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050416.30066, db61b783-50d7-4304-a031-f9fb11069ef1 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:00:31 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] VM Stopped (Lifecycle Event)
Aug 14 22:00:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b5dc6b0a-44ee-4768-b22f-aa56cf585dc4 None None] [instance: db61b783-50d7-4304-a031-f9fb11069ef1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Going to confirm migration 2 {{(pid=73144) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquired lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'info_cache' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating instance_info_cache with network_info: [{"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Releasing lock "refresh_cache-37ba2c90-f471-4c24-ada2-084734722610" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'migration_context' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:00:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.521s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:34 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Deleted allocation for migration fe0f91e2-92f2-42a6-aedd-9b3f67bd20bd
Aug 14 22:00:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1c3a7981-bbc8-4a24-b2b7-0e8f80734dc6 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.806s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-changed-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Refreshing instance network info cache due to event network-changed-83d55052-b49e-4993-906e-5b18b5819e95. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:00:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] Acquiring lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:00:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] Acquired lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:00:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Refreshing network info cache for port 83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:36 user nova-compute[73144]: INFO nova.compute.manager [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Terminating instance
Aug 14 22:00:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc3594bc-471c-41ab-be51-863c9113a687 req-f34d146b-7050-464e-ac63-c466617cde97 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-vif-unplugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc3594bc-471c-41ab-be51-863c9113a687 req-f34d146b-7050-464e-ac63-c466617cde97 service nova] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc3594bc-471c-41ab-be51-863c9113a687 req-f34d146b-7050-464e-ac63-c466617cde97 service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc3594bc-471c-41ab-be51-863c9113a687 req-f34d146b-7050-464e-ac63-c466617cde97 service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc3594bc-471c-41ab-be51-863c9113a687 req-f34d146b-7050-464e-ac63-c466617cde97 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] No waiting events found dispatching network-vif-unplugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc3594bc-471c-41ab-be51-863c9113a687 req-f34d146b-7050-464e-ac63-c466617cde97 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-vif-unplugged-83d55052-b49e-4993-906e-5b18b5819e95 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:00:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Instance destroyed successfully.
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'resources' on Instance uuid 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.network.neutron [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updated VIF entry in instance network info cache for port 83d55052-b49e-4993-906e-5b18b5819e95. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.network.neutron [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updating instance_info_cache with network_info: [{"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-364220799',display_name='tempest-TestStampPattern-server-364220799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-364220799',id=32,image_ref='f54a4257-4614-4e11-af8d-9633325642ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo+Eu6fj6m04L/OHnRQniRF3Yy0E2Y3eNFOhLDS/TGnK4cUO2zCBraPB+7Labc3TI7bXn/UiCDNG8VquktTfLQx3I7Xh7zvPhR0fzTI8bJ9GlpyZ8Xst4GgNE/zOTx0nA==',key_name='tempest-TestStampPattern-973921468',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:57:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d94f10ae206741b9b6e08ef94ea04537',ramdisk_id='',reservation_id='r-bjb92d96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4c8d3ab9-801b-41ba-ad20-2e202eccf0e7',image_min_disk='1',image_min_ram='0',image_owner_id='d94f10ae206741b9b6e08ef94ea04537',image_owner_project_name='tempest-TestStampPattern-2069970921',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2069970921-project-member',image_user_id='0b412578d976492cb05f9b674422687e',owner_project_name='tempest-TestStampPattern-2069970921',owner_user_name='tempest-TestStampPattern-2069970921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:57:46Z,user_data=None,user_id='0b412578d976492cb05f9b674422687e',uuid=3ae0ac74-2cb4-4920-8ee5-58747b3214c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converting VIF {"id": "83d55052-b49e-4993-906e-5b18b5819e95", "address": "fa:16:3e:ca:44:4f", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d55052-b4", "ovs_interfaceid": "83d55052-b49e-4993-906e-5b18b5819e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=83d55052-b49e-4993-906e-5b18b5819e95,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d55052-b4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG os_vif [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=83d55052-b49e-4993-906e-5b18b5819e95,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d55052-b4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83d55052-b4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:00:37 user nova-compute[73144]: INFO os_vif [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=83d55052-b49e-4993-906e-5b18b5819e95,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d55052-b4')
Aug 14 22:00:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Deleting instance files /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7_del
Aug 14 22:00:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Deletion of /opt/stack/data/nova/instances/3ae0ac74-2cb4-4920-8ee5-58747b3214c7_del complete
Aug 14 22:00:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b757e2b0-81f6-4478-9cc9-6d076840d330 req-c9ffec3a-f597-4153-b71b-6946565b055d service nova] Releasing lock "refresh_cache-3ae0ac74-2cb4-4920-8ee5-58747b3214c7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:00:37 user nova-compute[73144]: INFO nova.compute.manager [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 14 22:00:37 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:00:37 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Took 0.67 seconds to deallocate network for instance.
Aug 14 22:00:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:38 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:00:38 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:00:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:38 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Deleted allocations for instance 3ae0ac74-2cb4-4920-8ee5-58747b3214c7
Aug 14 22:00:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0cf167bc-8824-4a1c-98ff-a09d29832289 tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-01f2b7d3-d5d2-41b4-a6a6-7af5288c4c10 req-34014967-d319-4201-be13-5efa5072ad41 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-01f2b7d3-d5d2-41b4-a6a6-7af5288c4c10 req-34014967-d319-4201-be13-5efa5072ad41 service nova] Acquiring lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:00:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-01f2b7d3-d5d2-41b4-a6a6-7af5288c4c10 req-34014967-d319-4201-be13-5efa5072ad41 service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:00:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-01f2b7d3-d5d2-41b4-a6a6-7af5288c4c10 req-34014967-d319-4201-be13-5efa5072ad41 service nova] Lock "3ae0ac74-2cb4-4920-8ee5-58747b3214c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:00:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-01f2b7d3-d5d2-41b4-a6a6-7af5288c4c10 req-34014967-d319-4201-be13-5efa5072ad41 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] No waiting events found dispatching network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:00:39 user nova-compute[73144]: WARNING nova.compute.manager [req-01f2b7d3-d5d2-41b4-a6a6-7af5288c4c10 req-34014967-d319-4201-be13-5efa5072ad41 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received unexpected event network-vif-plugged-83d55052-b49e-4993-906e-5b18b5819e95 for instance with vm_state deleted and task_state None.
Aug 14 22:00:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-01f2b7d3-d5d2-41b4-a6a6-7af5288c4c10 req-34014967-d319-4201-be13-5efa5072ad41 service nova] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Received event network-vif-deleted-83d55052-b49e-4993-906e-5b18b5819e95 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:00:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:52 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050437.0151057, 3ae0ac74-2cb4-4920-8ee5-58747b3214c7 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:00:52 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] VM Stopped (Lifecycle Event)
Aug 14 22:00:52 user nova-compute[73144]: DEBUG nova.compute.manager [None req-96cad009-1b43-4883-98a7-778c2c77805c None None] [instance: 3ae0ac74-2cb4-4920-8ee5-58747b3214c7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:00:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:00:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:00 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 22:01:01 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:03 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 22:01:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 22:01:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:01:10 user nova-compute[73144]: INFO nova.compute.claims [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Claim successful on node user
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:01:10 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:01:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.policy [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11172444b2d54c0dae51f822168f586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69745a6a4d3345fcb143da4f825a2100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:01:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Creating image(s)
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk 1073741824" returned: 0 in 0.057s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Successfully created port: cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:01:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Cannot resize image /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'migration_context' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Ensure instance console log exists: /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Successfully updated port: cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-changed-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing instance network info cache due to event network-changed-cebad443-da70-41b3-aaee-7f539f336c43. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] Acquiring lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] Acquired lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing network info cache for port cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:01:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing instance network info cache due to event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] Acquiring lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] Acquired lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:13 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:13 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7206MB free_disk=24.93936538696289GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'flavor' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.network.neutron [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ff270b5b-146a-4b0a-9302-b7157342c1a9 req-77ba6a27-0533-4e68-8319-19b26eaf98e9 service nova] Releasing lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquired lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37ba2c90-f471-4c24-ada2-084734722610 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cbc94659-f76f-4b53-903b-60f59b0dfc55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:13 user nova-compute[73144]: INFO nova.compute.manager [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Attaching volume cb8f28dc-a84b-41e5-930d-ed39745a7bc3 to /dev/vdb
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG os_brick.utils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba9c24-a7bb-4674-84db-4d4017ef0e99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aee9eff-14c3-4853-97d4-e300f73b2248]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[79203d6a-ba6f-4b4b-892b-ec6b419faa08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[df667c40-9386-4fc7-a2ff-be568051f764]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:01:13 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:01:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d8338d-bcfa-43c7-969e-b83e1c4421ff]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG os_brick.utils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:01:13 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating existing volume attachment record: 12ea30b9-0f5d-4126-8605-d85d54c3a7a7 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updated VIF entry in instance network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5e932328-4eb9-404c-90a0-46abcb02cb4a req-a5834f78-d0c6-474a-90de-a07634b108de service nova] Releasing lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Releasing lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance network_info: |[{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Start _get_guest_xml network_info=[{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:01:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1260519476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1260519476',id=37,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg7+k97E4gOQGel8zFCAbRELmwjE2sZmKI52g4QtePhhLqymHK+/rKp/SVEfGvKmxiCl72q05G2EPOcEcHwc7qSEdErzlJSc+olT6uzcGGXX9CDqKKXbG3iQDalKb6jeQ==',key_name='tempest-keypair-1868290249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-r0cqfhri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=8098d577-b7b2-4881-aa10-5cca7f5ee0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'pci_devices' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.801s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:01:14 user nova-compute[73144]:   <uuid>8098d577-b7b2-4881-aa10-5cca7f5ee0f1</uuid>
Aug 14 22:01:14 user nova-compute[73144]:   <name>instance-00000025</name>
Aug 14 22:01:14 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:01:14 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:01:14 user nova-compute[73144]:   <metadata>
Aug 14 22:01:14 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:01:14 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:01:14 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1260519476</nova:name>
Aug 14 22:01:14 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:01:14</nova:creationTime>
Aug 14 22:01:14 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:01:14 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:01:14 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:01:14 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:01:14 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:01:14 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:01:14 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:01:14 user nova-compute[73144]:       <nova:owner>
Aug 14 22:01:14 user nova-compute[73144]:         <nova:user uuid="11172444b2d54c0dae51f822168f586a">tempest-AttachVolumeShelveTestJSON-1156240232-project-member</nova:user>
Aug 14 22:01:14 user nova-compute[73144]:         <nova:project uuid="69745a6a4d3345fcb143da4f825a2100">tempest-AttachVolumeShelveTestJSON-1156240232</nova:project>
Aug 14 22:01:14 user nova-compute[73144]:       </nova:owner>
Aug 14 22:01:14 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:01:14 user nova-compute[73144]:       <nova:ports>
Aug 14 22:01:14 user nova-compute[73144]:         <nova:port uuid="cebad443-da70-41b3-aaee-7f539f336c43">
Aug 14 22:01:14 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:01:14 user nova-compute[73144]:         </nova:port>
Aug 14 22:01:14 user nova-compute[73144]:       </nova:ports>
Aug 14 22:01:14 user nova-compute[73144]:     </nova:instance>
Aug 14 22:01:14 user nova-compute[73144]:   </metadata>
Aug 14 22:01:14 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:01:14 user nova-compute[73144]:     <system>
Aug 14 22:01:14 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:01:14 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:01:14 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:01:14 user nova-compute[73144]:       <entry name="serial">8098d577-b7b2-4881-aa10-5cca7f5ee0f1</entry>
Aug 14 22:01:14 user nova-compute[73144]:       <entry name="uuid">8098d577-b7b2-4881-aa10-5cca7f5ee0f1</entry>
Aug 14 22:01:14 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:01:14 user nova-compute[73144]:     </system>
Aug 14 22:01:14 user nova-compute[73144]:   </sysinfo>
Aug 14 22:01:14 user nova-compute[73144]:   <os>
Aug 14 22:01:14 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:01:14 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:01:14 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:01:14 user nova-compute[73144]:   </os>
Aug 14 22:01:14 user nova-compute[73144]:   <features>
Aug 14 22:01:14 user nova-compute[73144]:     <acpi/>
Aug 14 22:01:14 user nova-compute[73144]:     <apic/>
Aug 14 22:01:14 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:01:14 user nova-compute[73144]:   </features>
Aug 14 22:01:14 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:01:14 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:01:14 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:01:14 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:01:14 user nova-compute[73144]:   </clock>
Aug 14 22:01:14 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:01:14 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:01:14 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:01:14 user nova-compute[73144]:   </cpu>
Aug 14 22:01:14 user nova-compute[73144]:   <devices>
Aug 14 22:01:14 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:01:14 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:01:14 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk"/>
Aug 14 22:01:14 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:01:14 user nova-compute[73144]:     </disk>
Aug 14 22:01:14 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:01:14 user nova-compute[73144]:       <mac address="fa:16:3e:32:11:d9"/>
Aug 14 22:01:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:01:14 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:01:14 user nova-compute[73144]:       <target dev="tapcebad443-da"/>
Aug 14 22:01:14 user nova-compute[73144]:     </interface>
Aug 14 22:01:14 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:01:14 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/console.log" append="off"/>
Aug 14 22:01:14 user nova-compute[73144]:     </serial>
Aug 14 22:01:14 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:01:14 user nova-compute[73144]:     <video>
Aug 14 22:01:14 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:01:14 user nova-compute[73144]:     </video>
Aug 14 22:01:14 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:01:14 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:01:14 user nova-compute[73144]:     </rng>
Aug 14 22:01:14 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:01:14 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:01:14 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:01:14 user nova-compute[73144]:     </memballoon>
Aug 14 22:01:14 user nova-compute[73144]:   </devices>
Aug 14 22:01:14 user nova-compute[73144]: </domain>
Aug 14 22:01:14 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1260519476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1260519476',id=37,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg7+k97E4gOQGel8zFCAbRELmwjE2sZmKI52g4QtePhhLqymHK+/rKp/SVEfGvKmxiCl72q05G2EPOcEcHwc7qSEdErzlJSc+olT6uzcGGXX9CDqKKXbG3iQDalKb6jeQ==',key_name='tempest-keypair-1868290249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-r0cqfhri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=8098d577-b7b2-4881-aa10-5cca7f5ee0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG os_vif [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcebad443-da, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcebad443-da, col_values=(('external_ids', {'iface-id': 'cebad443-da70-41b3-aaee-7f539f336c43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:11:d9', 'vm-uuid': '8098d577-b7b2-4881-aa10-5cca7f5ee0f1'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:14 user nova-compute[73144]: INFO os_vif [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da')
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:01:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No VIF found with MAC fa:16:3e:32:11:d9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:01:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-e23d8dcf-df51-4fcf-9651-0e9a05399273 req-b29f2bbf-eeb2-4cdf-98fc-9bd09f815ade service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e23d8dcf-df51-4fcf-9651-0e9a05399273 req-b29f2bbf-eeb2-4cdf-98fc-9bd09f815ade service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e23d8dcf-df51-4fcf-9651-0e9a05399273 req-b29f2bbf-eeb2-4cdf-98fc-9bd09f815ade service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e23d8dcf-df51-4fcf-9651-0e9a05399273 req-b29f2bbf-eeb2-4cdf-98fc-9bd09f815ade service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-e23d8dcf-df51-4fcf-9651-0e9a05399273 req-b29f2bbf-eeb2-4cdf-98fc-9bd09f815ade service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:16 user nova-compute[73144]: WARNING nova.compute.manager [req-e23d8dcf-df51-4fcf-9651-0e9a05399273 req-b29f2bbf-eeb2-4cdf-98fc-9bd09f815ade service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received unexpected event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with vm_state building and task_state spawning.
Aug 14 22:01:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-88077267-1f43-4924-912c-94e1dac46380 req-1c00992e-57ae-447f-82e6-79e172a62a32 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88077267-1f43-4924-912c-94e1dac46380 req-1c00992e-57ae-447f-82e6-79e172a62a32 service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88077267-1f43-4924-912c-94e1dac46380 req-1c00992e-57ae-447f-82e6-79e172a62a32 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-88077267-1f43-4924-912c-94e1dac46380 req-1c00992e-57ae-447f-82e6-79e172a62a32 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-88077267-1f43-4924-912c-94e1dac46380 req-1c00992e-57ae-447f-82e6-79e172a62a32 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:18 user nova-compute[73144]: WARNING nova.compute.manager [req-88077267-1f43-4924-912c-94e1dac46380 req-1c00992e-57ae-447f-82e6-79e172a62a32 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received unexpected event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with vm_state building and task_state spawning.
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050478.2205672, 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:01:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] VM Resumed (Lifecycle Event)
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:01:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance spawned successfully.
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:01:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050478.2243352, 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:01:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] VM Started (Lifecycle Event)
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:01:18 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:01:18 user nova-compute[73144]: INFO nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Took 7.20 seconds to spawn the instance on the hypervisor.
Aug 14 22:01:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:18 user nova-compute[73144]: INFO nova.compute.manager [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Took 8.46 seconds to build instance.
Aug 14 22:01:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b6b259da-2324-4029-bcac-dd67b92b9536 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.568s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVDMxoOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:01:23 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:01:23 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:01:23 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f0a94-9896-476f-9825-42affd0bde27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:01:23 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cf33ce-9c48-47c5-b35e-c3ebc312d888]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3] added
Aug 14 22:01:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f188ce-fbfb-4897-9698-710c64cfea08]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9c5a6-6324-46bf-9a29-0794595f7616]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVDMxoOq {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVDMxoOq" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d4b4bd-2ef3-44af-9fa8-60c1318bb81d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVDMxoOq'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4373a3-c040-47b6-b640-13b2b419a976]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1561f2af-7b90-4388-9860-ae0853734430]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:01:23 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:01:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:01:23 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:01:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[53904f0f-5192-419d-aacd-da5d5e45fa7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260]
Aug 14 22:01:23 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260] successful.
Aug 14 22:01:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c1d80-4694-44c9-838e-a97658c51993]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:01:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9ebc32-abe4-43eb-b129-a7fbf9f90acd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:01:24 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:01:24 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:01:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:01:24 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:01:24 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:01:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[20347b88-e493-4e48-93f8-57ce84e4e8b1]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVDMxoOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:01:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23732386563343230', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732386563343230', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG nova.objects.instance [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'flavor' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:01:25 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:01:25 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:01:25 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:01:25 user nova-compute[73144]:   <serial>cb8f28dc-a84b-41e5-930d-ed39745a7bc3</serial>
Aug 14 22:01:25 user nova-compute[73144]: </disk>
Aug 14 22:01:25 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No VIF found with MAC fa:16:3e:e0:d1:46, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:01:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-c1ef20bc-b28e-4520-a297-aa6817aeb865 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.042s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:26 user nova-compute[73144]: INFO nova.compute.manager [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Rescuing
Aug 14 22:01:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:01:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-9a79f096-39c4-47a9-a185-4e78c6cc89e4 req-1d1046e3-f8e5-42ae-ba5c-2fcac42a5373 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9a79f096-39c4-47a9-a185-4e78c6cc89e4 req-1d1046e3-f8e5-42ae-ba5c-2fcac42a5373 service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9a79f096-39c4-47a9-a185-4e78c6cc89e4 req-1d1046e3-f8e5-42ae-ba5c-2fcac42a5373 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9a79f096-39c4-47a9-a185-4e78c6cc89e4 req-1d1046e3-f8e5-42ae-ba5c-2fcac42a5373 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-9a79f096-39c4-47a9-a185-4e78c6cc89e4 req-1d1046e3-f8e5-42ae-ba5c-2fcac42a5373 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:27 user nova-compute[73144]: WARNING nova.compute.manager [req-9a79f096-39c4-47a9-a185-4e78c6cc89e4 req-1d1046e3-f8e5-42ae-ba5c-2fcac42a5373 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state active and task_state rescuing.
Aug 14 22:01:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance destroyed successfully.
Aug 14 22:01:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Attempting rescue
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73144) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 22:01:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Creating image(s)
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'trusted_certs' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue" returned: 0 in 0.051s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'migration_context' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Start _get_guest_xml network_info=[{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:e0:d1:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '53539290-1600-4e84-8f24-496f41396a43', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:01:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'resources' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'numa_topology' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:28 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:28 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'vcpu_model' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944081948',display_name='tempest-ServerRescueNegativeTestJSON-server-944081948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944081948',id=33,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTxvFBpA115FRLzrCvh9O4wn7LkFvcpc5chtex4LDkdpOfKw8PHe6LbUNmXc+k8oMdCHMqCUtthA30tOtsLMkNZ5VBAgvGuhT2XkWx67lJ2Jx0LDdk8nGIkJwQjdgh+Rg==',key_name='tempest-keypair-417536897',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ju0iijj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:59:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:e0:d1:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "vif_mac": "fa:16:3e:e0:d1:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.objects.instance [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'pci_devices' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:01:28 user nova-compute[73144]:   <uuid>f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66</uuid>
Aug 14 22:01:28 user nova-compute[73144]:   <name>instance-00000021</name>
Aug 14 22:01:28 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:01:28 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:01:28 user nova-compute[73144]:   <metadata>
Aug 14 22:01:28 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:01:28 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:01:28 user nova-compute[73144]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-944081948</nova:name>
Aug 14 22:01:28 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:01:28</nova:creationTime>
Aug 14 22:01:28 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:01:28 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:01:28 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:01:28 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:01:28 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:01:28 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:01:28 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:01:28 user nova-compute[73144]:       <nova:owner>
Aug 14 22:01:28 user nova-compute[73144]:         <nova:user uuid="8d90a89f0b384bfbbabfc57e098efc45">tempest-ServerRescueNegativeTestJSON-89538024-project-member</nova:user>
Aug 14 22:01:28 user nova-compute[73144]:         <nova:project uuid="8cc2faa54982470a8ff513ec75cf0546">tempest-ServerRescueNegativeTestJSON-89538024</nova:project>
Aug 14 22:01:28 user nova-compute[73144]:       </nova:owner>
Aug 14 22:01:28 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:01:28 user nova-compute[73144]:       <nova:ports>
Aug 14 22:01:28 user nova-compute[73144]:         <nova:port uuid="b484bc7b-fb19-4a51-ab9b-aafb744e31ff">
Aug 14 22:01:28 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 22:01:28 user nova-compute[73144]:         </nova:port>
Aug 14 22:01:28 user nova-compute[73144]:       </nova:ports>
Aug 14 22:01:28 user nova-compute[73144]:     </nova:instance>
Aug 14 22:01:28 user nova-compute[73144]:   </metadata>
Aug 14 22:01:28 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:01:28 user nova-compute[73144]:     <system>
Aug 14 22:01:28 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:01:28 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:01:28 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:01:28 user nova-compute[73144]:       <entry name="serial">f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66</entry>
Aug 14 22:01:28 user nova-compute[73144]:       <entry name="uuid">f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66</entry>
Aug 14 22:01:28 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:01:28 user nova-compute[73144]:     </system>
Aug 14 22:01:28 user nova-compute[73144]:   </sysinfo>
Aug 14 22:01:28 user nova-compute[73144]:   <os>
Aug 14 22:01:28 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:01:28 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:01:28 user nova-compute[73144]:   </os>
Aug 14 22:01:28 user nova-compute[73144]:   <features>
Aug 14 22:01:28 user nova-compute[73144]:     <acpi/>
Aug 14 22:01:28 user nova-compute[73144]:     <apic/>
Aug 14 22:01:28 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:01:28 user nova-compute[73144]:   </features>
Aug 14 22:01:28 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:01:28 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:01:28 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:01:28 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:01:28 user nova-compute[73144]:   </clock>
Aug 14 22:01:28 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:01:28 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:01:28 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:01:28 user nova-compute[73144]:   </cpu>
Aug 14 22:01:28 user nova-compute[73144]:   <devices>
Aug 14 22:01:28 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:01:28 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:01:28 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue"/>
Aug 14 22:01:28 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:01:28 user nova-compute[73144]:     </disk>
Aug 14 22:01:28 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:01:28 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:01:28 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk"/>
Aug 14 22:01:28 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 22:01:28 user nova-compute[73144]:     </disk>
Aug 14 22:01:28 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:01:28 user nova-compute[73144]:       <mac address="fa:16:3e:e0:d1:46"/>
Aug 14 22:01:28 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:01:28 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:01:28 user nova-compute[73144]:       <target dev="tapb484bc7b-fb"/>
Aug 14 22:01:28 user nova-compute[73144]:     </interface>
Aug 14 22:01:28 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:01:28 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/console.log" append="off"/>
Aug 14 22:01:28 user nova-compute[73144]:     </serial>
Aug 14 22:01:28 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:01:28 user nova-compute[73144]:     <video>
Aug 14 22:01:28 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:01:28 user nova-compute[73144]:     </video>
Aug 14 22:01:28 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:01:28 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:01:28 user nova-compute[73144]:     </rng>
Aug 14 22:01:28 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:01:28 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:01:28 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:01:28 user nova-compute[73144]:     </memballoon>
Aug 14 22:01:28 user nova-compute[73144]:   </devices>
Aug 14 22:01:28 user nova-compute[73144]: </domain>
Aug 14 22:01:28 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:01:28 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance destroyed successfully.
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] No VIF found with MAC fa:16:3e:e0:d1:46, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:01:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-8db753d1-ea05-46c9-89f1-ed94e30e41d6 req-9d8bf298-088d-4cdc-b52f-80ffb2c66b7d service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8db753d1-ea05-46c9-89f1-ed94e30e41d6 req-9d8bf298-088d-4cdc-b52f-80ffb2c66b7d service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8db753d1-ea05-46c9-89f1-ed94e30e41d6 req-9d8bf298-088d-4cdc-b52f-80ffb2c66b7d service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8db753d1-ea05-46c9-89f1-ed94e30e41d6 req-9d8bf298-088d-4cdc-b52f-80ffb2c66b7d service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-8db753d1-ea05-46c9-89f1-ed94e30e41d6 req-9d8bf298-088d-4cdc-b52f-80ffb2c66b7d service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:29 user nova-compute[73144]: WARNING nova.compute.manager [req-8db753d1-ea05-46c9-89f1-ed94e30e41d6 req-9d8bf298-088d-4cdc-b52f-80ffb2c66b7d service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state active and task_state rescuing.
Aug 14 22:01:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid b38d8d04-d91a-49d3-9350-e44d2ba576cf {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 6f7f7181-df25-4e9a-b990-251cabf0129c {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 87c08427-5779-444e-a6d0-afdc7b5c96ca {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ef7cd461-517e-458c-a22a-d226daf54347" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "37ba2c90-f471-4c24-ada2-084734722610" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: INFO nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "37ba2c90-f471-4c24-ada2-084734722610" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "ef7cd461-517e-458c-a22a-d226daf54347" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:31 user nova-compute[73144]: INFO nova.compute.manager [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] instance snapshotting
Aug 14 22:01:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Beginning live snapshot process
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050492.4776013, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:01:32 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] VM Resumed (Lifecycle Event)
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json -f qcow2" returned: 0 in 0.234s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json -f qcow2 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-cdb176d8-4d05-4ade-b3b2-197aabcf89a8 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:01:32 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050492.48201, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:01:32 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] VM Started (Lifecycle Event)
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-cbf32301-925e-467b-9d6e-850750db03b2 req-cbd26b73-1b2b-4f19-97d3-23b0379c9620 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cbf32301-925e-467b-9d6e-850750db03b2 req-cbd26b73-1b2b-4f19-97d3-23b0379c9620 service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cbf32301-925e-467b-9d6e-850750db03b2 req-cbd26b73-1b2b-4f19-97d3-23b0379c9620 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cbf32301-925e-467b-9d6e-850750db03b2 req-cbd26b73-1b2b-4f19-97d3-23b0379c9620 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-cbf32301-925e-467b-9d6e-850750db03b2 req-cbd26b73-1b2b-4f19-97d3-23b0379c9620 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:32 user nova-compute[73144]: WARNING nova.compute.manager [req-cbf32301-925e-467b-9d6e-850750db03b2 req-cbd26b73-1b2b-4f19-97d3-23b0379c9620 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state active and task_state rescuing.
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4t64olis/5a92b02a2ab7400aa4215da7015720cb.delta 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4t64olis/5a92b02a2ab7400aa4215da7015720cb.delta 1073741824" returned: 0 in 0.059s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 22:01:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73144) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:01:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 22:01:34 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4t64olis/5a92b02a2ab7400aa4215da7015720cb.delta /opt/stack/data/nova/instances/snapshots/tmp4t64olis/5a92b02a2ab7400aa4215da7015720cb {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-037f94a8-3d54-486f-94da-e952c35493a6 req-29066d76-6fbf-4a75-a66c-f2746c51f085 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-037f94a8-3d54-486f-94da-e952c35493a6 req-29066d76-6fbf-4a75-a66c-f2746c51f085 service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-037f94a8-3d54-486f-94da-e952c35493a6 req-29066d76-6fbf-4a75-a66c-f2746c51f085 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-037f94a8-3d54-486f-94da-e952c35493a6 req-29066d76-6fbf-4a75-a66c-f2746c51f085 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-037f94a8-3d54-486f-94da-e952c35493a6 req-29066d76-6fbf-4a75-a66c-f2746c51f085 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:34 user nova-compute[73144]: WARNING nova.compute.manager [req-037f94a8-3d54-486f-94da-e952c35493a6 req-29066d76-6fbf-4a75-a66c-f2746c51f085 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state rescued and task_state None.
Aug 14 22:01:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4t64olis/5a92b02a2ab7400aa4215da7015720cb.delta /opt/stack/data/nova/instances/snapshots/tmp4t64olis/5a92b02a2ab7400aa4215da7015720cb" returned: 0 in 0.732s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Snapshot extracted, beginning image upload
Aug 14 22:01:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Snapshot image upload complete
Aug 14 22:01:38 user nova-compute[73144]: INFO nova.compute.manager [None req-308e17ed-3b4e-4317-802c-0a0d61a34b90 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Took 6.33 seconds to snapshot the instance on the hypervisor.
Aug 14 22:01:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:01:38 user nova-compute[73144]: INFO nova.compute.claims [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Claim successful on node user
Aug 14 22:01:38 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:01:39 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:01:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:01:39 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Creating image(s)
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "/opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "/opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG nova.policy [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9aaa5b6401a94224ab2ac216ef372ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a47f6f6752451688eadc99352b7101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.213s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk 1073741824" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-changed-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Refreshing instance network info cache due to event network-changed-6b98003c-89e7-4f8a-a57c-426f0dab822a. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] Acquiring lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] Acquired lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.network.neutron [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Refreshing network info cache for port 6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.network.neutron [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Successfully created port: 6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Cannot resize image /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.objects.instance [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'migration_context' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Ensure instance console log exists: /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:40 user nova-compute[73144]: INFO nova.compute.manager [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Terminating instance
Aug 14 22:01:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.neutron [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updated VIF entry in instance network info cache for port 6b98003c-89e7-4f8a-a57c-426f0dab822a. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.neutron [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updating instance_info_cache with network_info: [{"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-871f4028-c701-4b7b-8a21-cac93342a007 req-12e26f08-8018-4745-b31e-6a2fd7f7a8b8 service nova] Releasing lock "refresh_cache-4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Instance destroyed successfully.
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lazy-loading 'resources' on Instance uuid 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:54:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1075166230',display_name='tempest-TestStampPattern-server-1075166230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1075166230',id=27,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo+Eu6fj6m04L/OHnRQniRF3Yy0E2Y3eNFOhLDS/TGnK4cUO2zCBraPB+7Labc3TI7bXn/UiCDNG8VquktTfLQx3I7Xh7zvPhR0fzTI8bJ9GlpyZ8Xst4GgNE/zOTx0nA==',key_name='tempest-TestStampPattern-973921468',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d94f10ae206741b9b6e08ef94ea04537',ramdisk_id='',reservation_id='r-5agwcs3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2069970921',owner_user_name='tempest-TestStampPattern-2069970921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:57:34Z,user_data=None,user_id='0b412578d976492cb05f9b674422687e',uuid=4c8d3ab9-801b-41ba-ad20-2e202eccf0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converting VIF {"id": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "address": "fa:16:3e:13:43:a5", "network": {"id": "ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a", "bridge": "br-int", "label": "tempest-TestStampPattern-817189350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d94f10ae206741b9b6e08ef94ea04537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b98003c-89", "ovs_interfaceid": "6b98003c-89e7-4f8a-a57c-426f0dab822a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:43:a5,bridge_name='br-int',has_traffic_filtering=True,id=6b98003c-89e7-4f8a-a57c-426f0dab822a,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b98003c-89') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG os_vif [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:43:a5,bridge_name='br-int',has_traffic_filtering=True,id=6b98003c-89e7-4f8a-a57c-426f0dab822a,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b98003c-89') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b98003c-89, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:01:41 user nova-compute[73144]: INFO os_vif [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:43:a5,bridge_name='br-int',has_traffic_filtering=True,id=6b98003c-89e7-4f8a-a57c-426f0dab822a,network=Network(ea5f3f98-938c-46bf-bb13-fb0ddc6dd34a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b98003c-89')
Aug 14 22:01:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Deleting instance files /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7_del
Aug 14 22:01:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Deletion of /opt/stack/data/nova/instances/4c8d3ab9-801b-41ba-ad20-2e202eccf0e7_del complete
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Successfully updated port: 6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:01:41 user nova-compute[73144]: INFO nova.compute.manager [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 14 22:01:41 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquired lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-changed-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Refreshing instance network info cache due to event network-changed-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] Acquiring lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:01:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating instance_info_cache with network_info: [{"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Releasing lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Instance network_info: |[{"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] Acquired lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Refreshing network info cache for port 6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Start _get_guest_xml network_info=[{"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:01:42 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:42 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-747128264',display_name='tempest-SnapshotDataIntegrityTests-server-747128264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-747128264',id=38,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu4u+25FUswVrnKFWU9mDFM5uCty0BQANPlm6Kndqtgy0derDqD3NUFEaPB1YMJAw44SSJkVd4cd/kKZFW6BVpaDqHq4TFznOOm3ee96JabWrGpD8FaBOa2ihzLV8RTqg==',key_name='tempest-keypair-747473871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55a47f6f6752451688eadc99352b7101',ramdisk_id='',reservation_id='r-c32q9h0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1633399023',owner_user_name='tempest-SnapshotDataIntegrityTests-1633399023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aaa5b6401a94224ab2ac216ef372ef9',uuid=e5f03cb8-f350-4e69-af26-1a40519be4da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Converting VIF {"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:55,bridge_name='br-int',has_traffic_filtering=True,id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551,network=Network(ff49a0dd-cd48-4ae8-89c0-932196eed92e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f34fee3-11') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.objects.instance [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'pci_devices' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:01:42 user nova-compute[73144]:   <uuid>e5f03cb8-f350-4e69-af26-1a40519be4da</uuid>
Aug 14 22:01:42 user nova-compute[73144]:   <name>instance-00000026</name>
Aug 14 22:01:42 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:01:42 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:01:42 user nova-compute[73144]:   <metadata>
Aug 14 22:01:42 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:01:42 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:01:42 user nova-compute[73144]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-747128264</nova:name>
Aug 14 22:01:42 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:01:42</nova:creationTime>
Aug 14 22:01:42 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:01:42 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:01:42 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:01:42 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:01:42 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:01:42 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:01:42 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:01:42 user nova-compute[73144]:       <nova:owner>
Aug 14 22:01:42 user nova-compute[73144]:         <nova:user uuid="9aaa5b6401a94224ab2ac216ef372ef9">tempest-SnapshotDataIntegrityTests-1633399023-project-member</nova:user>
Aug 14 22:01:42 user nova-compute[73144]:         <nova:project uuid="55a47f6f6752451688eadc99352b7101">tempest-SnapshotDataIntegrityTests-1633399023</nova:project>
Aug 14 22:01:42 user nova-compute[73144]:       </nova:owner>
Aug 14 22:01:42 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:01:42 user nova-compute[73144]:       <nova:ports>
Aug 14 22:01:42 user nova-compute[73144]:         <nova:port uuid="6f34fee3-11e7-454d-b6c5-c8dbbd3b4551">
Aug 14 22:01:42 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:01:42 user nova-compute[73144]:         </nova:port>
Aug 14 22:01:42 user nova-compute[73144]:       </nova:ports>
Aug 14 22:01:42 user nova-compute[73144]:     </nova:instance>
Aug 14 22:01:42 user nova-compute[73144]:   </metadata>
Aug 14 22:01:42 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:01:42 user nova-compute[73144]:     <system>
Aug 14 22:01:42 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:01:42 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:01:42 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:01:42 user nova-compute[73144]:       <entry name="serial">e5f03cb8-f350-4e69-af26-1a40519be4da</entry>
Aug 14 22:01:42 user nova-compute[73144]:       <entry name="uuid">e5f03cb8-f350-4e69-af26-1a40519be4da</entry>
Aug 14 22:01:42 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:01:42 user nova-compute[73144]:     </system>
Aug 14 22:01:42 user nova-compute[73144]:   </sysinfo>
Aug 14 22:01:42 user nova-compute[73144]:   <os>
Aug 14 22:01:42 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:01:42 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:01:42 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:01:42 user nova-compute[73144]:   </os>
Aug 14 22:01:42 user nova-compute[73144]:   <features>
Aug 14 22:01:42 user nova-compute[73144]:     <acpi/>
Aug 14 22:01:42 user nova-compute[73144]:     <apic/>
Aug 14 22:01:42 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:01:42 user nova-compute[73144]:   </features>
Aug 14 22:01:42 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:01:42 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:01:42 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:01:42 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:01:42 user nova-compute[73144]:   </clock>
Aug 14 22:01:42 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:01:42 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:01:42 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:01:42 user nova-compute[73144]:   </cpu>
Aug 14 22:01:42 user nova-compute[73144]:   <devices>
Aug 14 22:01:42 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:01:42 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:01:42 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk"/>
Aug 14 22:01:42 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:01:42 user nova-compute[73144]:     </disk>
Aug 14 22:01:42 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:01:42 user nova-compute[73144]:       <mac address="fa:16:3e:98:44:55"/>
Aug 14 22:01:42 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:01:42 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:01:42 user nova-compute[73144]:       <target dev="tap6f34fee3-11"/>
Aug 14 22:01:42 user nova-compute[73144]:     </interface>
Aug 14 22:01:42 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:01:42 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/console.log" append="off"/>
Aug 14 22:01:42 user nova-compute[73144]:     </serial>
Aug 14 22:01:42 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:01:42 user nova-compute[73144]:     <video>
Aug 14 22:01:42 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:01:42 user nova-compute[73144]:     </video>
Aug 14 22:01:42 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:01:42 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:01:42 user nova-compute[73144]:     </rng>
Aug 14 22:01:42 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:01:42 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:01:42 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:01:42 user nova-compute[73144]:     </memballoon>
Aug 14 22:01:42 user nova-compute[73144]:   </devices>
Aug 14 22:01:42 user nova-compute[73144]: </domain>
Aug 14 22:01:42 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-747128264',display_name='tempest-SnapshotDataIntegrityTests-server-747128264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-747128264',id=38,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu4u+25FUswVrnKFWU9mDFM5uCty0BQANPlm6Kndqtgy0derDqD3NUFEaPB1YMJAw44SSJkVd4cd/kKZFW6BVpaDqHq4TFznOOm3ee96JabWrGpD8FaBOa2ihzLV8RTqg==',key_name='tempest-keypair-747473871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55a47f6f6752451688eadc99352b7101',ramdisk_id='',reservation_id='r-c32q9h0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1633399023',owner_user_name='tempest-SnapshotDataIntegrityTests-1633399023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aaa5b6401a94224ab2ac216ef372ef9',uuid=e5f03cb8-f350-4e69-af26-1a40519be4da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Converting VIF {"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:55,bridge_name='br-int',has_traffic_filtering=True,id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551,network=Network(ff49a0dd-cd48-4ae8-89c0-932196eed92e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f34fee3-11') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG os_vif [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:55,bridge_name='br-int',has_traffic_filtering=True,id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551,network=Network(ff49a0dd-cd48-4ae8-89c0-932196eed92e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f34fee3-11') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f34fee3-11, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f34fee3-11, col_values=(('external_ids', {'iface-id': '6f34fee3-11e7-454d-b6c5-c8dbbd3b4551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:44:55', 'vm-uuid': 'e5f03cb8-f350-4e69-af26-1a40519be4da'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:01:42 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Took 0.60 seconds to deallocate network for instance.
Aug 14 22:01:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:42 user nova-compute[73144]: INFO os_vif [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:55,bridge_name='br-int',has_traffic_filtering=True,id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551,network=Network(ff49a0dd-cd48-4ae8-89c0-932196eed92e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f34fee3-11')
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No VIF found with MAC fa:16:3e:98:44:55, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-vif-unplugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] No waiting events found dispatching network-vif-unplugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:42 user nova-compute[73144]: WARNING nova.compute.manager [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received unexpected event network-vif-unplugged-6b98003c-89e7-4f8a-a57c-426f0dab822a for instance with vm_state deleted and task_state None.
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] Acquiring lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] No waiting events found dispatching network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:42 user nova-compute[73144]: WARNING nova.compute.manager [req-4a9b92af-1b9a-448e-bc47-d4b57027d7ce req-c25ac26f-30fb-4212-84e1-83eb97301a16 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received unexpected event network-vif-plugged-6b98003c-89e7-4f8a-a57c-426f0dab822a for instance with vm_state deleted and task_state None.
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updated VIF entry in instance network info cache for port 6f34fee3-11e7-454d-b6c5-c8dbbd3b4551. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating instance_info_cache with network_info: [{"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-36114744-a559-4fc9-9ff3-2064053f3837 req-6ec26058-d570-4d64-ba6f-d0f407b0e42e service nova] Releasing lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:01:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:42 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Deleted allocations for instance 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7
Aug 14 22:01:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae89fdd3-0e35-493e-a895-0db523a13b8a tempest-TestStampPattern-2069970921 tempest-TestStampPattern-2069970921-project-member] Lock "4c8d3ab9-801b-41ba-ad20-2e202eccf0e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-f38c145b-8ef9-4c6a-8d43-e1da4c29fffa req-3e30d3dd-5e23-4647-b748-929eadf8e8c0 service nova] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Received event network-vif-deleted-6b98003c-89e7-4f8a-a57c-426f0dab822a {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] No waiting events found dispatching network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:44 user nova-compute[73144]: WARNING nova.compute.manager [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received unexpected event network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 for instance with vm_state building and task_state spawning.
Aug 14 22:01:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:44 user nova-compute[73144]: DEBUG nova.compute.manager [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] No waiting events found dispatching network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:01:44 user nova-compute[73144]: WARNING nova.compute.manager [req-0fcaddb4-79e1-452d-86cf-abb1529bc494 req-b23d51de-7306-45b1-a179-387ce3771be2 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received unexpected event network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 for instance with vm_state building and task_state spawning.
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050506.0376863, e5f03cb8-f350-4e69-af26-1a40519be4da => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:01:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] VM Resumed (Lifecycle Event)
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:01:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Instance spawned successfully.
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:01:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050506.0387516, e5f03cb8-f350-4e69-af26-1a40519be4da => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:01:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] VM Started (Lifecycle Event)
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:01:46 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:01:46 user nova-compute[73144]: INFO nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Took 6.63 seconds to spawn the instance on the hypervisor.
Aug 14 22:01:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:46 user nova-compute[73144]: INFO nova.compute.manager [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Took 7.90 seconds to build instance.
Aug 14 22:01:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-05851caf-b31b-4063-afd6-d77c8e2f03ab tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.057s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:01:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:56 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050501.5211942, 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:01:56 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] VM Stopped (Lifecycle Event)
Aug 14 22:01:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8da726f2-22b0-4009-bb3c-c5f2d12f2595 None None] [instance: 4c8d3ab9-801b-41ba-ad20-2e202eccf0e7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:01:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:01:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:06 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:08 user nova-compute[73144]: INFO nova.compute.manager [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Terminating instance
Aug 14 22:02:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-958dfd6a-a49b-42d0-a1d2-80c34d96f631 req-2d5aa657-4b27-44a3-89c6-d6a7bb550f6b service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received event network-vif-unplugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-958dfd6a-a49b-42d0-a1d2-80c34d96f631 req-2d5aa657-4b27-44a3-89c6-d6a7bb550f6b service nova] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-958dfd6a-a49b-42d0-a1d2-80c34d96f631 req-2d5aa657-4b27-44a3-89c6-d6a7bb550f6b service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-958dfd6a-a49b-42d0-a1d2-80c34d96f631 req-2d5aa657-4b27-44a3-89c6-d6a7bb550f6b service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-958dfd6a-a49b-42d0-a1d2-80c34d96f631 req-2d5aa657-4b27-44a3-89c6-d6a7bb550f6b service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] No waiting events found dispatching network-vif-unplugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-958dfd6a-a49b-42d0-a1d2-80c34d96f631 req-2d5aa657-4b27-44a3-89c6-d6a7bb550f6b service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received event network-vif-unplugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Instance destroyed successfully.
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.objects.instance [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lazy-loading 'resources' on Instance uuid 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-477580037',display_name='tempest-VolumesNegativeTest-instance-477580037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-477580037',id=36,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedc6ea9da7460f920eab6f6affeb92',ramdisk_id='',reservation_id='r-0ps960cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2122835154',owner_user_name='tempest-VolumesNegativeTest-2122835154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:00:27Z,user_data=None,user_id='388ab65745f84dee929d1a4a06ec3b31',uuid=7d01cc08-97b5-415b-a1ad-a6121fbcf4b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Converting VIF {"id": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "address": "fa:16:3e:f6:cd:a3", "network": {"id": "c2f88d6f-f5f4-4a73-8e22-0e907bb9a134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c8de138933604706be0b674829ad5577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9157e5b9-fe", "ovs_interfaceid": "9157e5b9-feb1-4474-b03a-3cd7ee34bf70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cd:a3,bridge_name='br-int',has_traffic_filtering=True,id=9157e5b9-feb1-4474-b03a-3cd7ee34bf70,network=Network(c2f88d6f-f5f4-4a73-8e22-0e907bb9a134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9157e5b9-fe') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG os_vif [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cd:a3,bridge_name='br-int',has_traffic_filtering=True,id=9157e5b9-feb1-4474-b03a-3cd7ee34bf70,network=Network(c2f88d6f-f5f4-4a73-8e22-0e907bb9a134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9157e5b9-fe') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9157e5b9-fe, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:09 user nova-compute[73144]: INFO os_vif [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cd:a3,bridge_name='br-int',has_traffic_filtering=True,id=9157e5b9-feb1-4474-b03a-3cd7ee34bf70,network=Network(c2f88d6f-f5f4-4a73-8e22-0e907bb9a134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9157e5b9-fe')
Aug 14 22:02:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Deleting instance files /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2_del
Aug 14 22:02:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Deletion of /opt/stack/data/nova/instances/7d01cc08-97b5-415b-a1ad-a6121fbcf4b2_del complete
Aug 14 22:02:09 user nova-compute[73144]: INFO nova.compute.manager [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:10 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Took 0.67 seconds to deallocate network for instance.
Aug 14 22:02:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-5064a486-79fd-4fee-b901-f48affeba57a req-53ea1b00-7dcf-4867-8913-d97e9a01cc03 service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received event network-vif-deleted-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'flavor' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:10 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Deleted allocations for instance 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:10 user nova-compute[73144]: INFO nova.compute.manager [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Attaching volume 73678973-2507-452c-90a3-f6c2e0c3dbb2 to /dev/vdb
Aug 14 22:02:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12908be9-11f4-48c5-9842-3578741f3ccc tempest-VolumesNegativeTest-2122835154 tempest-VolumesNegativeTest-2122835154-project-member] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.285s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG os_brick.utils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a3d1d9-58f6-4722-886f-46c32f6221e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-0459ba14-66d5-49e4-8d5d-cd4ced44175b req-fd1d24f0-2a19-4920-b577-94f1f76677ee service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received event network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0459ba14-66d5-49e4-8d5d-cd4ced44175b req-fd1d24f0-2a19-4920-b577-94f1f76677ee service nova] Acquiring lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0459ba14-66d5-49e4-8d5d-cd4ced44175b req-fd1d24f0-2a19-4920-b577-94f1f76677ee service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0459ba14-66d5-49e4-8d5d-cd4ced44175b req-fd1d24f0-2a19-4920-b577-94f1f76677ee service nova] Lock "7d01cc08-97b5-415b-a1ad-a6121fbcf4b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-0459ba14-66d5-49e4-8d5d-cd4ced44175b req-fd1d24f0-2a19-4920-b577-94f1f76677ee service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] No waiting events found dispatching network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:02:11 user nova-compute[73144]: WARNING nova.compute.manager [req-0459ba14-66d5-49e4-8d5d-cd4ced44175b req-fd1d24f0-2a19-4920-b577-94f1f76677ee service nova] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Received unexpected event network-vif-plugged-9157e5b9-feb1-4474-b03a-3cd7ee34bf70 for instance with vm_state deleted and task_state None.
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8242f46e-ec02-4d90-8878-00d15805d5f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d8c963-aeac-4353-bbca-00d87b62fe28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec4320-50eb-4685-83d6-13ad74c60c66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:02:11 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881ac5b-6de1-40c4-b69b-4109a8ef0505]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG os_brick.utils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating existing volume attachment record: 2a292d1e-0763-4739-b228-6a282ac9f330 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid '7d01cc08-97b5-415b-a1ad-a6121fbcf4b2' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid '7d01cc08-97b5-415b-a1ad-a6121fbcf4b2' (instance-00000024)
Aug 14 22:02:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:13 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:02:13 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7082MB free_disk=24.946304321289062GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37ba2c90-f471-4c24-ada2-084734722610 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cbc94659-f76f-4b53-903b-60f59b0dfc55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:02:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:18 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:18 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:02:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:02:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:02:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:02:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updating instance_info_cache with network_info: [{"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:02:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-ef7cd461-517e-458c-a22a-d226daf54347" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:02:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:02:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYIAgUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:02:20 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:02:20 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:02:20 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5840e406-ea60-41b3-810a-88041c0d4ab2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:02:20 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9aa0ac-f2e9-4c09-9bd4-c720364e0af9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2] added
Aug 14 22:02:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed26c6c-ecaf-440f-a004-c65115cb53bf]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7867b8-878e-42f8-b87e-c9f3c1955cb3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYIAgUvP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYIAgUvP" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65f90b9-f45c-4989-9c28-f5ba15456a03]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wYIAgUvP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d20224b-b1de-4bc7-89ca-7e64c6b85074]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a46308-46e1-4d97-9db3-e7558cc86cad]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafea413-d99c-4044-b28a-31ec14a15c08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]
Aug 14 22:02:20 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.
Aug 14 22:02:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b662e7-c10d-42a4-9715-e5d8494e6001]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1b8b04-50c2-4d00-882d-06df4370161f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:02:20 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e276f7-2127-4fc6-b83a-fbddee66640e]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:02:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYIAgUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23765376265353262', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765376265353262', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'flavor' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:02:21 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:02:21 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 22:02:21 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:02:21 user nova-compute[73144]:   <serial>73678973-2507-452c-90a3-f6c2e0c3dbb2</serial>
Aug 14 22:02:21 user nova-compute[73144]: </disk>
Aug 14 22:02:21 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:02:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No VIF found with MAC fa:16:3e:81:41:b2, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:02:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcafeafa-a3b5-4b8c-a646-655aa7e7ddfe tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.074s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:24 user nova-compute[73144]: INFO nova.compute.manager [None req-c3834abe-5fab-4e6b-ab1f-ddc8369bd2ca tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Get console output
Aug 14 22:02:24 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050529.2975907, 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:02:24 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] VM Stopped (Lifecycle Event)
Aug 14 22:02:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e14d25d5-2a24-4807-9f4a-048a6c75177b None None] [instance: 7d01cc08-97b5-415b-a1ad-a6121fbcf4b2] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:02:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:02:24 user nova-compute[73144]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 22:02:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing instance network info cache due to event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:02:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] Acquiring lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:02:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] Acquired lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:02:32 user nova-compute[73144]: DEBUG nova.network.neutron [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:02:33 user nova-compute[73144]: DEBUG nova.network.neutron [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updated VIF entry in instance network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:02:33 user nova-compute[73144]: DEBUG nova.network.neutron [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:02:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c3fd3f9d-6ed5-4374-a4a7-11e22854a348 req-669e6c5a-cdbc-4882-b5c3-dbf18b7efe95 service nova] Releasing lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:02:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:02:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing instance network info cache due to event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:02:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] Acquiring lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:02:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] Acquired lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:02:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:02:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updated VIF entry in instance network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:02:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:02:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8af8d878-ce89-43bc-aa17-db4a863b2a8c req-de3d2c3d-a153-468e-a61d-3cb33de3d010 service nova] Releasing lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:02:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:02:41 user nova-compute[73144]: INFO nova.compute.claims [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Claim successful on node user
Aug 14 22:02:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:02:41 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:02:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:02:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:02:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:02:42 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:02:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:02:42 user nova-compute[73144]: INFO nova.virt.block_device [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Booting with volume-backed-image 53539290-1600-4e84-8f24-496f41396a43 at /dev/vda
Aug 14 22:02:42 user nova-compute[73144]: DEBUG nova.policy [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe8b1fc0405438c99d3edd956e103a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e45dfdc13e486e950f6bc8595bb8fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Successfully created port: 529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:43 user nova-compute[73144]: INFO nova.compute.manager [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Rebooting instance
Aug 14 22:02:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquired lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Successfully updated port: 529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG nova.network.neutron [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-changed-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Refreshing instance network info cache due to event network-changed-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:02:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] Acquiring lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Updating instance_info_cache with network_info: [{"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance network_info: |[{"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] Acquired lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Refreshing network info cache for port 529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Releasing lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Updated VIF entry in instance network info cache for port 529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG nova.network.neutron [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Updating instance_info_cache with network_info: [{"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:02:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-087f68fc-221f-4e2a-a676-03819ab1323e req-c0b9a52c-8a90-4925-a8d5-ac2801575c22 service nova] Releasing lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:02:45 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance destroyed successfully.
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'resources' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872334805',display_name='tempest-TestMinimumBasicScenario-server-1872334805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872334805',id=35,image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1HtMIZDB5L2KiUNfOZ1iQNQmfkn3XwTU3u05v5z3hwMkd5vEOICMxCq0xcnImKICtaZ9ksOizbJ9rvRBHmEIzz+elqoLnyXq7QW2fSP+wbW77K6e23dr7hFN1osHAQUQ==',key_name='tempest-TestMinimumBasicScenario-24525501',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-wwyngt8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:02:44Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cbc94659-f76f-4b53-903b-60f59b0dfc55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_vif [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape11dc58f-a4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:02:45 user nova-compute[73144]: INFO os_vif [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4')
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYIAgUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:02:45 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50d2aa-35bf-47a0-a91a-05a15785f1cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a64cb9-a92d-4ea6-abfb-a9b5b6836167]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586b9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c0b755-b6eb-414f-baf4-4f86928a309b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec9657-4e88-4544-8c94-16f6236a33f7]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c67d59b-8c83-41d2-bcd8-a4c281e7323b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2428e75-98f9-489d-a0db-de6c31eb692d]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc58dab2-94ef-419a-970b-a60b6b934947]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0f819a-73f9-46f3-bfbc-be121b10837f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]
Aug 14 22:02:45 user nova-compute[73144]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.
Aug 14 22:02:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[344fa8dc-3bee-4329-99f9-c2eae8f7a87b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== disconnect_volume: return (324ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Start _get_guest_xml network_info=[{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=943601c3-7bf1-4cb6-86ae-bc63be3769d5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '943601c3-7bf1-4cb6-86ae-bc63be3769d5'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '2a292d1e-0763-4739-b228-6a282ac9f330', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYIAgUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cbc94659-f76f-4b53-903b-60f59b0dfc55', 'attached_at': '', 'detached_at': '', 'volume_id': '73678973-2507-452c-90a3-f6c2e0c3dbb2', 'serial': '73678973-2507-452c-90a3-f6c2e0c3dbb2'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:02:45 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:02:45 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=943601c3-7bf1-4cb6-86ae-bc63be3769d5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'vcpu_model' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYIAgUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:02:45 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:02:45 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:02:45 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c4ddcf-6c43-47af-a241-1c3e3f376f30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:02:45 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4396c5b-559b-4cbf-9689-600a02de2caa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2] added
Aug 14 22:02:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26c71b-8ea0-4496-aeb0-8be35f4dd30b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c6274d-f238-41e3-bcd4-52b8d8ec4590]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYIAgUvP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYIAgUvP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d024946-5330-4fcc-a88d-ddce52429ce4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wYIAgUvP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[233da86a-f183-4a80-ac88-1f4b3ed91a73]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[da412963-fe6d-441e-8a6a-d083a4a16796]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:45 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:02:45 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-unplugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-unplugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:02:46 user nova-compute[73144]: WARNING nova.compute.manager [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received unexpected event network-vif-unplugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with vm_state active and task_state reboot_started_hard.
Aug 14 22:02:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:02:46 user nova-compute[73144]: WARNING nova.compute.manager [req-9fb1f533-91db-48a7-9bc3-7c32775dc253 req-91b5768b-34fd-4935-8bf3-1144efd58ea0 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received unexpected event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with vm_state active and task_state reboot_started_hard.
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a29f050-0932-48d9-9bf4-4c2a5128f928]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]
Aug 14 22:02:46 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.
Aug 14 22:02:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8d7f5-8400-47fd-bf9f-7bc843d99f31]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[51241dae-c431-40a6-8dae-fb9b5dae87d4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:02:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[268c1228-b4c1-423e-8865-bfafa429c354]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:02:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYIAgUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23765376265353262', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765376265353262', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872334805',display_name='tempest-TestMinimumBasicScenario-server-1872334805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872334805',id=35,image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1HtMIZDB5L2KiUNfOZ1iQNQmfkn3XwTU3u05v5z3hwMkd5vEOICMxCq0xcnImKICtaZ9ksOizbJ9rvRBHmEIzz+elqoLnyXq7QW2fSP+wbW77K6e23dr7hFN1osHAQUQ==',key_name='tempest-TestMinimumBasicScenario-24525501',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-wwyngt8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:02:44Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cbc94659-f76f-4b53-903b-60f59b0dfc55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'pci_devices' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:02:47 user nova-compute[73144]:   <uuid>cbc94659-f76f-4b53-903b-60f59b0dfc55</uuid>
Aug 14 22:02:47 user nova-compute[73144]:   <name>instance-00000023</name>
Aug 14 22:02:47 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:02:47 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:02:47 user nova-compute[73144]:   <metadata>
Aug 14 22:02:47 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:02:47 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:02:47 user nova-compute[73144]:       <nova:name>tempest-TestMinimumBasicScenario-server-1872334805</nova:name>
Aug 14 22:02:47 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:02:45</nova:creationTime>
Aug 14 22:02:47 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:02:47 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:02:47 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:02:47 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:02:47 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:02:47 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:02:47 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:02:47 user nova-compute[73144]:       <nova:owner>
Aug 14 22:02:47 user nova-compute[73144]:         <nova:user uuid="f5b646bc914e419e987ebada26905446">tempest-TestMinimumBasicScenario-1966855885-project-member</nova:user>
Aug 14 22:02:47 user nova-compute[73144]:         <nova:project uuid="6d1319de1ca444198f3edddf26ce07b1">tempest-TestMinimumBasicScenario-1966855885</nova:project>
Aug 14 22:02:47 user nova-compute[73144]:       </nova:owner>
Aug 14 22:02:47 user nova-compute[73144]:       <nova:root type="image" uuid="943601c3-7bf1-4cb6-86ae-bc63be3769d5"/>
Aug 14 22:02:47 user nova-compute[73144]:       <nova:ports>
Aug 14 22:02:47 user nova-compute[73144]:         <nova:port uuid="e11dc58f-a416-43a7-b0b9-73ee1dd7382d">
Aug 14 22:02:47 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 22:02:47 user nova-compute[73144]:         </nova:port>
Aug 14 22:02:47 user nova-compute[73144]:       </nova:ports>
Aug 14 22:02:47 user nova-compute[73144]:     </nova:instance>
Aug 14 22:02:47 user nova-compute[73144]:   </metadata>
Aug 14 22:02:47 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:02:47 user nova-compute[73144]:     <system>
Aug 14 22:02:47 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:02:47 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:02:47 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:02:47 user nova-compute[73144]:       <entry name="serial">cbc94659-f76f-4b53-903b-60f59b0dfc55</entry>
Aug 14 22:02:47 user nova-compute[73144]:       <entry name="uuid">cbc94659-f76f-4b53-903b-60f59b0dfc55</entry>
Aug 14 22:02:47 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:02:47 user nova-compute[73144]:     </system>
Aug 14 22:02:47 user nova-compute[73144]:   </sysinfo>
Aug 14 22:02:47 user nova-compute[73144]:   <os>
Aug 14 22:02:47 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:02:47 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:02:47 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:02:47 user nova-compute[73144]:   </os>
Aug 14 22:02:47 user nova-compute[73144]:   <features>
Aug 14 22:02:47 user nova-compute[73144]:     <acpi/>
Aug 14 22:02:47 user nova-compute[73144]:     <apic/>
Aug 14 22:02:47 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:02:47 user nova-compute[73144]:   </features>
Aug 14 22:02:47 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:02:47 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:02:47 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:02:47 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:02:47 user nova-compute[73144]:   </clock>
Aug 14 22:02:47 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:02:47 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:02:47 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:02:47 user nova-compute[73144]:   </cpu>
Aug 14 22:02:47 user nova-compute[73144]:   <devices>
Aug 14 22:02:47 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:02:47 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:02:47 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk"/>
Aug 14 22:02:47 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:02:47 user nova-compute[73144]:     </disk>
Aug 14 22:02:47 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:02:47 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:02:47 user nova-compute[73144]:       <source dev="/dev/sde"/>
Aug 14 22:02:47 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 22:02:47 user nova-compute[73144]:       <serial>73678973-2507-452c-90a3-f6c2e0c3dbb2</serial>
Aug 14 22:02:47 user nova-compute[73144]:     </disk>
Aug 14 22:02:47 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:02:47 user nova-compute[73144]:       <mac address="fa:16:3e:81:41:b2"/>
Aug 14 22:02:47 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:02:47 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:02:47 user nova-compute[73144]:       <target dev="tape11dc58f-a4"/>
Aug 14 22:02:47 user nova-compute[73144]:     </interface>
Aug 14 22:02:47 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:02:47 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/console.log" append="off"/>
Aug 14 22:02:47 user nova-compute[73144]:     </serial>
Aug 14 22:02:47 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:02:47 user nova-compute[73144]:     <video>
Aug 14 22:02:47 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:02:47 user nova-compute[73144]:     </video>
Aug 14 22:02:47 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:02:47 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:02:47 user nova-compute[73144]:     </rng>
Aug 14 22:02:47 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:02:47 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:02:47 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:02:47 user nova-compute[73144]:     </memballoon>
Aug 14 22:02:47 user nova-compute[73144]:   </devices>
Aug 14 22:02:47 user nova-compute[73144]: </domain>
Aug 14 22:02:47 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'trusted_certs' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Cannot resize image /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'migration_context' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872334805',display_name='tempest-TestMinimumBasicScenario-server-1872334805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872334805',id=35,image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1HtMIZDB5L2KiUNfOZ1iQNQmfkn3XwTU3u05v5z3hwMkd5vEOICMxCq0xcnImKICtaZ9ksOizbJ9rvRBHmEIzz+elqoLnyXq7QW2fSP+wbW77K6e23dr7hFN1osHAQUQ==',key_name='tempest-TestMinimumBasicScenario-24525501',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-wwyngt8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:02:44Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cbc94659-f76f-4b53-903b-60f59b0dfc55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:02:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG os_vif [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape11dc58f-a4, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape11dc58f-a4, col_values=(('external_ids', {'iface-id': 'e11dc58f-a416-43a7-b0b9-73ee1dd7382d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:41:b2', 'vm-uuid': 'cbc94659-f76f-4b53-903b-60f59b0dfc55'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:02:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:48 user nova-compute[73144]: INFO os_vif [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4')
Aug 14 22:02:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-8548b1aa-186e-4e5c-ad66-f61ce08aed4b req-df048eb0-eeb7-4ef7-abc6-49f7be3efa1f service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8548b1aa-186e-4e5c-ad66-f61ce08aed4b req-df048eb0-eeb7-4ef7-abc6-49f7be3efa1f service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8548b1aa-186e-4e5c-ad66-f61ce08aed4b req-df048eb0-eeb7-4ef7-abc6-49f7be3efa1f service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8548b1aa-186e-4e5c-ad66-f61ce08aed4b req-df048eb0-eeb7-4ef7-abc6-49f7be3efa1f service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-8548b1aa-186e-4e5c-ad66-f61ce08aed4b req-df048eb0-eeb7-4ef7-abc6-49f7be3efa1f service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:02:49 user nova-compute[73144]: WARNING nova.compute.manager [req-8548b1aa-186e-4e5c-ad66-f61ce08aed4b req-df048eb0-eeb7-4ef7-abc6-49f7be3efa1f service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received unexpected event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with vm_state active and task_state reboot_started_hard.
Aug 14 22:02:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc272af9-69f4-473f-b8f4-fe9ae3e81a7f req-18f44897-7356-4958-9708-e07ad539ef53 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc272af9-69f4-473f-b8f4-fe9ae3e81a7f req-18f44897-7356-4958-9708-e07ad539ef53 service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc272af9-69f4-473f-b8f4-fe9ae3e81a7f req-18f44897-7356-4958-9708-e07ad539ef53 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dc272af9-69f4-473f-b8f4-fe9ae3e81a7f req-18f44897-7356-4958-9708-e07ad539ef53 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-dc272af9-69f4-473f-b8f4-fe9ae3e81a7f req-18f44897-7356-4958-9708-e07ad539ef53 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:02:51 user nova-compute[73144]: WARNING nova.compute.manager [req-dc272af9-69f4-473f-b8f4-fe9ae3e81a7f req-18f44897-7356-4958-9708-e07ad539ef53 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received unexpected event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with vm_state active and task_state reboot_started_hard.
Aug 14 22:02:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for cbc94659-f76f-4b53-903b-60f59b0dfc55 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050571.8185225, cbc94659-f76f-4b53-903b-60f59b0dfc55 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:02:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] VM Resumed (Lifecycle Event)
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:02:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance rebooted successfully.
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:02:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050571.8197224, cbc94659-f76f-4b53-903b-60f59b0dfc55 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:02:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] VM Started (Lifecycle Event)
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:02:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0d1b6d4-d0e9-4f47-9b0f-14736d844803 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.783s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:02:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:02:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-changed-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing instance network info cache due to event network-changed-cebad443-da70-41b3-aaee-7f539f336c43. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:03:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] Acquiring lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] Acquired lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:01 user nova-compute[73144]: DEBUG nova.network.neutron [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing network info cache for port cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:03:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updated VIF entry in instance network info cache for port cebad443-da70-41b3-aaee-7f539f336c43. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:03:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68023fe1-7be5-4529-a710-7b4e4aaf91cd req-23b09c82-2fd1-4469-86a1-e9bf1f0c0636 service nova] Releasing lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG os_brick.utils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d30a00-004b-4b44-99cb-4a8184deb664]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75bb1d-c02f-4766-b254-7232721f0492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2f83ba-bcbb-4d63-b572-60397a21f617]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e46d88-fbef-455e-a944-eeb2c06b8067]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:03:03 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:03:03 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9822da0c-fe04-45cb-af3c-b47ddbcdf0f9]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG os_brick.utils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:03:03 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Updating existing volume attachment record: 6a25054a-2327-41f2-8c2f-24115884c3eb {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:03:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:07 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:08 user nova-compute[73144]: INFO nova.compute.manager [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Shelving
Aug 14 22:03:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-8eb43878-d774-4520-94ae-265bb74d18dd req-131a3f33-1a63-47dd-b725-5388f99a7306 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-unplugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8eb43878-d774-4520-94ae-265bb74d18dd req-131a3f33-1a63-47dd-b725-5388f99a7306 service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8eb43878-d774-4520-94ae-265bb74d18dd req-131a3f33-1a63-47dd-b725-5388f99a7306 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8eb43878-d774-4520-94ae-265bb74d18dd req-131a3f33-1a63-47dd-b725-5388f99a7306 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-8eb43878-d774-4520-94ae-265bb74d18dd req-131a3f33-1a63-47dd-b725-5388f99a7306 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-unplugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:09 user nova-compute[73144]: WARNING nova.compute.manager [req-8eb43878-d774-4520-94ae-265bb74d18dd req-131a3f33-1a63-47dd-b725-5388f99a7306 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received unexpected event network-vif-unplugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with vm_state active and task_state shelving.
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:03:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance destroyed successfully.
Aug 14 22:03:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Beginning cold snapshot process
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:03:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk /opt/stack/data/nova/instances/snapshots/tmpl9mwe8ct/45f40585dd2d4c058a9a607612c71201 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk /opt/stack/data/nova/instances/snapshots/tmpl9mwe8ct/45f40585dd2d4c058a9a607612c71201" returned: 0 in 0.642s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Snapshot extracted, beginning image upload
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-b13c0cfa-6b51-4118-8b2b-464a721e87aa req-de7b86a3-ecfc-448f-b27b-837a48d516b1 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b13c0cfa-6b51-4118-8b2b-464a721e87aa req-de7b86a3-ecfc-448f-b27b-837a48d516b1 service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b13c0cfa-6b51-4118-8b2b-464a721e87aa req-de7b86a3-ecfc-448f-b27b-837a48d516b1 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b13c0cfa-6b51-4118-8b2b-464a721e87aa req-de7b86a3-ecfc-448f-b27b-837a48d516b1 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-b13c0cfa-6b51-4118-8b2b-464a721e87aa req-de7b86a3-ecfc-448f-b27b-837a48d516b1 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:11 user nova-compute[73144]: WARNING nova.compute.manager [req-b13c0cfa-6b51-4118-8b2b-464a721e87aa req-de7b86a3-ecfc-448f-b27b-837a48d516b1 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received unexpected event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Snapshot image upload complete
Aug 14 22:03:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:13 user nova-compute[73144]: INFO nova.compute.manager [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Shelve offloading
Aug 14 22:03:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance destroyed successfully.
Aug 14 22:03:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquired lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:03:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=24.950016021728516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Releasing lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:03:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Creating image(s)
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Ensure instance console log exists: /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Start _get_guest_xml network_info=[{"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '6a25054a-2327-41f2-8c2f-24115884c3eb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeclJjms', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c0cb840-2ddf-4a02-9a74-92339044bed4', 'attached_at': '', 'detached_at': '', 'volume_id': 'f084d871-c546-4c9f-8808-a8e3611341c0', 'serial': 'f084d871-c546-4c9f-8808-a8e3611341c0'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:03:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:03:14 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeclJjms', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:03:14 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:03:14 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:03:14 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37ba2c90-f471-4c24-ada2-084734722610 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cbc94659-f76f-4b53-903b-60f59b0dfc55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c0cb840-2ddf-4a02-9a74-92339044bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd3b36d-68a9-4305-8ce1-bd915f94b267]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:03:14 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08a328b-1a16-4ef8-8230-20334228c627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0] added
Aug 14 22:03:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caca942-3bbb-4f39-9cb6-ce7e2ab813d2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b98a5-cd10-4bf6-b9fa-4b1423ac5a78]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeclJjms {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeclJjms" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c610aa-4687-4e56-99e2-87403f5fb475]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EeclJjms'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f2efdd-2337-471d-a05b-cd69132e0052]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c75c9e-eea4-4364-9a5d-f563a29babba]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[656b5594-94da-41a3-b7c2-05f02cbb9dfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260]
Aug 14 22:03:14 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260] successful.
Aug 14 22:03:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a2a35e-7638-4c78-91aa-562c17bce319]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[25284525-328c-4fd2-bde8-c52b26e0a450]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df05d31-f443-4a9c-a7fd-2b7de2c49556]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeclJjms', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance destroyed successfully.
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'resources' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1260519476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1260519476',id=37,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg7+k97E4gOQGel8zFCAbRELmwjE2sZmKI52g4QtePhhLqymHK+/rKp/SVEfGvKmxiCl72q05G2EPOcEcHwc7qSEdErzlJSc+olT6uzcGGXX9CDqKKXbG3iQDalKb6jeQ==',key_name='tempest-keypair-1868290249',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-r0cqfhri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member',shelved_at='2023-08-14T22:03:13.169778',shelved_host='user',shelved_image_id='c11dc728-94fb-40c8-8daf-f38cb64608b2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=8098d577-b7b2-4881-aa10-5cca7f5ee0f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG os_vif [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcebad443-da, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:03:15 user nova-compute[73144]: INFO os_vif [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da')
Aug 14 22:03:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Deleting instance files /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1_del
Aug 14 22:03:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Deletion of /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1_del complete
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-changed-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing instance network info cache due to event network-changed-cebad443-da70-41b3-aaee-7f539f336c43. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] Acquiring lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] Acquired lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing network info cache for port cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:03:15 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Deleted allocations for instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1
Aug 14 22:03:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'numa_topology' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updated VIF entry in instance network info cache for port cebad443-da70-41b3-aaee-7f539f336c43. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcebad443-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26438376536303732', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438376536303732', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e51e34a9-ffee-44f8-81a9-3f403833096d req-c64f5581-f385-4cd4-a883-74312ff615e0 service nova] Releasing lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:02:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-537812427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-537812427',id=39,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-j7pgyuwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:02:42Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=4c0cb840-2ddf-4a02-9a74-92339044bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:03:16 user nova-compute[73144]:   <uuid>4c0cb840-2ddf-4a02-9a74-92339044bed4</uuid>
Aug 14 22:03:16 user nova-compute[73144]:   <name>instance-00000027</name>
Aug 14 22:03:16 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:03:16 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:03:16 user nova-compute[73144]:   <metadata>
Aug 14 22:03:16 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:03:16 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:03:16 user nova-compute[73144]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-537812427</nova:name>
Aug 14 22:03:16 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:03:14</nova:creationTime>
Aug 14 22:03:16 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:03:16 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:03:16 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:03:16 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:03:16 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:03:16 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:03:16 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:03:16 user nova-compute[73144]:       <nova:owner>
Aug 14 22:03:16 user nova-compute[73144]:         <nova:user uuid="cfe8b1fc0405438c99d3edd956e103a4">tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member</nova:user>
Aug 14 22:03:16 user nova-compute[73144]:         <nova:project uuid="59e45dfdc13e486e950f6bc8595bb8fa">tempest-ServerBootFromVolumeStableRescueTest-847208830</nova:project>
Aug 14 22:03:16 user nova-compute[73144]:       </nova:owner>
Aug 14 22:03:16 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:03:16 user nova-compute[73144]:       <nova:ports>
Aug 14 22:03:16 user nova-compute[73144]:         <nova:port uuid="529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f">
Aug 14 22:03:16 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 22:03:16 user nova-compute[73144]:         </nova:port>
Aug 14 22:03:16 user nova-compute[73144]:       </nova:ports>
Aug 14 22:03:16 user nova-compute[73144]:     </nova:instance>
Aug 14 22:03:16 user nova-compute[73144]:   </metadata>
Aug 14 22:03:16 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:03:16 user nova-compute[73144]:     <system>
Aug 14 22:03:16 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:03:16 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:03:16 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:03:16 user nova-compute[73144]:       <entry name="serial">4c0cb840-2ddf-4a02-9a74-92339044bed4</entry>
Aug 14 22:03:16 user nova-compute[73144]:       <entry name="uuid">4c0cb840-2ddf-4a02-9a74-92339044bed4</entry>
Aug 14 22:03:16 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:03:16 user nova-compute[73144]:     </system>
Aug 14 22:03:16 user nova-compute[73144]:   </sysinfo>
Aug 14 22:03:16 user nova-compute[73144]:   <os>
Aug 14 22:03:16 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:03:16 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:03:16 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:03:16 user nova-compute[73144]:   </os>
Aug 14 22:03:16 user nova-compute[73144]:   <features>
Aug 14 22:03:16 user nova-compute[73144]:     <acpi/>
Aug 14 22:03:16 user nova-compute[73144]:     <apic/>
Aug 14 22:03:16 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:03:16 user nova-compute[73144]:   </features>
Aug 14 22:03:16 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:03:16 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:03:16 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:03:16 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:03:16 user nova-compute[73144]:   </clock>
Aug 14 22:03:16 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:03:16 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:03:16 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:03:16 user nova-compute[73144]:   </cpu>
Aug 14 22:03:16 user nova-compute[73144]:   <devices>
Aug 14 22:03:16 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:03:16 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:03:16 user nova-compute[73144]:       <source dev="/dev/sdf"/>
Aug 14 22:03:16 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:03:16 user nova-compute[73144]:       <serial>f084d871-c546-4c9f-8808-a8e3611341c0</serial>
Aug 14 22:03:16 user nova-compute[73144]:     </disk>
Aug 14 22:03:16 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:03:16 user nova-compute[73144]:       <mac address="fa:16:3e:c1:c6:28"/>
Aug 14 22:03:16 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:03:16 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:03:16 user nova-compute[73144]:       <target dev="tap529f9817-6a"/>
Aug 14 22:03:16 user nova-compute[73144]:     </interface>
Aug 14 22:03:16 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:03:16 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/console.log" append="off"/>
Aug 14 22:03:16 user nova-compute[73144]:     </serial>
Aug 14 22:03:16 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:03:16 user nova-compute[73144]:     <video>
Aug 14 22:03:16 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:03:16 user nova-compute[73144]:     </video>
Aug 14 22:03:16 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:03:16 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:03:16 user nova-compute[73144]:     </rng>
Aug 14 22:03:16 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:03:16 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:03:16 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:03:16 user nova-compute[73144]:     </memballoon>
Aug 14 22:03:16 user nova-compute[73144]:   </devices>
Aug 14 22:03:16 user nova-compute[73144]: </domain>
Aug 14 22:03:16 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:02:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-537812427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-537812427',id=39,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-j7pgyuwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:02:42Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=4c0cb840-2ddf-4a02-9a74-92339044bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG os_vif [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap529f9817-6a, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap529f9817-6a, col_values=(('external_ids', {'iface-id': '529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c6:28', 'vm-uuid': '4c0cb840-2ddf-4a02-9a74-92339044bed4'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:16 user nova-compute[73144]: INFO os_vif [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a')
Aug 14 22:03:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e0344d1d-7b49-49a4-9698-3c047021833a tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.214s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No VIF found with MAC fa:16:3e:c1:c6:28, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:03:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:17 user nova-compute[73144]: INFO nova.compute.manager [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Unrescuing
Aug 14 22:03:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquired lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:17 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:03:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-d8f9fd7c-ff41-4a4b-962b-a7805f0a1562 req-594ef2d7-7647-4249-a6b1-b3a62255673f service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d8f9fd7c-ff41-4a4b-962b-a7805f0a1562 req-594ef2d7-7647-4249-a6b1-b3a62255673f service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d8f9fd7c-ff41-4a4b-962b-a7805f0a1562 req-594ef2d7-7647-4249-a6b1-b3a62255673f service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d8f9fd7c-ff41-4a4b-962b-a7805f0a1562 req-594ef2d7-7647-4249-a6b1-b3a62255673f service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-d8f9fd7c-ff41-4a4b-962b-a7805f0a1562 req-594ef2d7-7647-4249-a6b1-b3a62255673f service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:18 user nova-compute[73144]: WARNING nova.compute.manager [req-d8f9fd7c-ff41-4a4b-962b-a7805f0a1562 req-594ef2d7-7647-4249-a6b1-b3a62255673f service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state building and task_state spawning.
Aug 14 22:03:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Releasing lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'flavor' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-b5dcb181-2600-4941-ba8e-73017a945507 req-ed574bc3-6084-46c9-a260-8eed9f660631 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b5dcb181-2600-4941-ba8e-73017a945507 req-ed574bc3-6084-46c9-a260-8eed9f660631 service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b5dcb181-2600-4941-ba8e-73017a945507 req-ed574bc3-6084-46c9-a260-8eed9f660631 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b5dcb181-2600-4941-ba8e-73017a945507 req-ed574bc3-6084-46c9-a260-8eed9f660631 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-b5dcb181-2600-4941-ba8e-73017a945507 req-ed574bc3-6084-46c9-a260-8eed9f660631 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:18 user nova-compute[73144]: WARNING nova.compute.manager [req-b5dcb181-2600-4941-ba8e-73017a945507 req-ed574bc3-6084-46c9-a260-8eed9f660631 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:03:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:19 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance destroyed successfully.
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050599.7918968, 4c0cb840-2ddf-4a02-9a74-92339044bed4 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:03:19 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] VM Resumed (Lifecycle Event)
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:03:19 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance spawned successfully.
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:03:19 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050599.7952895, 4c0cb840-2ddf-4a02-9a74-92339044bed4 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:03:19 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] VM Started (Lifecycle Event)
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:03:19 user nova-compute[73144]: INFO nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 14 22:03:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:19 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:03:20 user nova-compute[73144]: INFO nova.compute.manager [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Took 38.51 seconds to build instance.
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-9aab71cf-ce7b-45e3-8b40-a7637a5f53c0 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.770s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-d66b3535-8874-48a5-a665-93e5ed34774d req-786d814a-2fd2-4fa0-b950-b43d68ea13a5 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d66b3535-8874-48a5-a665-93e5ed34774d req-786d814a-2fd2-4fa0-b950-b43d68ea13a5 service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d66b3535-8874-48a5-a665-93e5ed34774d req-786d814a-2fd2-4fa0-b950-b43d68ea13a5 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d66b3535-8874-48a5-a665-93e5ed34774d req-786d814a-2fd2-4fa0-b950-b43d68ea13a5 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-d66b3535-8874-48a5-a665-93e5ed34774d req-786d814a-2fd2-4fa0-b950-b43d68ea13a5 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:20 user nova-compute[73144]: WARNING nova.compute.manager [req-d66b3535-8874-48a5-a665-93e5ed34774d req-786d814a-2fd2-4fa0-b950-b43d68ea13a5 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state active and task_state None.
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:21 user nova-compute[73144]: WARNING nova.compute.manager [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:03:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG nova.compute.manager [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:21 user nova-compute[73144]: WARNING nova.compute.manager [req-c2f3dbf0-80c4-4968-b3da-d9994e8825f9 req-c024f751-7838-418c-9eb9-c28574d3ad5f service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:03:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-a465b0a2-03a3-4938-bd51-996eb5417e31 req-e2018d7d-f3b5-43fb-bbff-2272553e845c service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a465b0a2-03a3-4938-bd51-996eb5417e31 req-e2018d7d-f3b5-43fb-bbff-2272553e845c service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a465b0a2-03a3-4938-bd51-996eb5417e31 req-e2018d7d-f3b5-43fb-bbff-2272553e845c service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a465b0a2-03a3-4938-bd51-996eb5417e31 req-e2018d7d-f3b5-43fb-bbff-2272553e845c service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-a465b0a2-03a3-4938-bd51-996eb5417e31 req-e2018d7d-f3b5-43fb-bbff-2272553e845c service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:23 user nova-compute[73144]: WARNING nova.compute.manager [req-a465b0a2-03a3-4938-bd51-996eb5417e31 req-e2018d7d-f3b5-43fb-bbff-2272553e845c service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050603.1992607, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:03:23 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] VM Resumed (Lifecycle Event)
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1cdf0a4a-bfb6-409e-a8c7-9c9d19867a17 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:03:23 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050603.200842, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:03:23 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] VM Started (Lifecycle Event)
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:03:24 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050589.6208525, 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:03:24 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] VM Stopped (Lifecycle Event)
Aug 14 22:03:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d863383c-91c1-4458-b66a-dab1900e1c75 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:25 user nova-compute[73144]: INFO nova.compute.manager [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Terminating instance
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-68a3db91-f09e-443b-ac9e-07dbda20c9c4 req-ac013243-edef-4ca8-9e4e-a3f55524141a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-unplugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68a3db91-f09e-443b-ac9e-07dbda20c9c4 req-ac013243-edef-4ca8-9e4e-a3f55524141a service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68a3db91-f09e-443b-ac9e-07dbda20c9c4 req-ac013243-edef-4ca8-9e4e-a3f55524141a service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68a3db91-f09e-443b-ac9e-07dbda20c9c4 req-ac013243-edef-4ca8-9e4e-a3f55524141a service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-68a3db91-f09e-443b-ac9e-07dbda20c9c4 req-ac013243-edef-4ca8-9e4e-a3f55524141a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-unplugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-68a3db91-f09e-443b-ac9e-07dbda20c9c4 req-ac013243-edef-4ca8-9e4e-a3f55524141a service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-unplugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:03:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Instance destroyed successfully.
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'resources' on Instance uuid 37ba2c90-f471-4c24-ada2-084734722610 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-446237050',display_name='tempest-ServerActionsTestOtherA-server-446237050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-446237050',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:59:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-0tv7sgub',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=37ba2c90-f471-4c24-ada2-084734722610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "648e988b-1d10-4829-932b-88c863dc0cfa", "address": "fa:16:3e:7d:81:4b", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648e988b-1d", "ovs_interfaceid": "648e988b-1d10-4829-932b-88c863dc0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG os_vif [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap648e988b-1d, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:03:25 user nova-compute[73144]: INFO os_vif [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=648e988b-1d10-4829-932b-88c863dc0cfa,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648e988b-1d')
Aug 14 22:03:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnzgOpiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:03:25 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:03:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:03:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3e865-84c0-444e-8845-a2c5b71a1289]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf65839d-3e56-4956-b112-1ae0c5812391]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17856d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd45b08a-3943-43fd-85d9-7a3a5778c02d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[72146b19-3dfd-4f4a-ae1e-e06a80fd1ee0]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[709376f0-d391-4038-b327-07afa9dbd0ee]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7759e86-1ab0-4e34-9723-e1bbb19c363f]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe5ca4289-f9b8a871f657cae0', '/dev/disk/by-id/scsi-26639623861383731', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e5ca4289') {{(pid=84572) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131677a-531a-44f8-b324-1a251586e88a]: (4, None) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3603b0-716b-439b-b7e7-4638ecdbce9a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[683136ff-1ebc-4d4b-9d47-26384e8d3605]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260]
Aug 14 22:03:26 user nova-compute[73144]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2, portal: 172.16.0.220,3260] successful.
Aug 14 22:03:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:582a8584-1c29-4bc1-ab9a-fac4705091d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[339afec1-aef8-4b71-a596-8e1bdacf7665]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] <== disconnect_volume: return (316ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:03:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Deleting instance files /opt/stack/data/nova/instances/37ba2c90-f471-4c24-ada2-084734722610_del
Aug 14 22:03:26 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Deletion of /opt/stack/data/nova/instances/37ba2c90-f471-4c24-ada2-084734722610_del complete
Aug 14 22:03:26 user nova-compute[73144]: INFO nova.compute.manager [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 14 22:03:26 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:03:26 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:03:27 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:27 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Took 1.01 seconds to deallocate network for instance.
Aug 14 22:03:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-44d3ef5b-bc12-4ab5-836e-78ae9d056a82 req-28645534-98a3-43d0-9f7d-e7702c962473 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-deleted-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-6510c3cf-ecd4-45c6-a9cd-5a807fb0ad8f req-1188044c-02f3-4d58-879f-7cdf3e172021 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6510c3cf-ecd4-45c6-a9cd-5a807fb0ad8f req-1188044c-02f3-4d58-879f-7cdf3e172021 service nova] Acquiring lock "37ba2c90-f471-4c24-ada2-084734722610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6510c3cf-ecd4-45c6-a9cd-5a807fb0ad8f req-1188044c-02f3-4d58-879f-7cdf3e172021 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6510c3cf-ecd4-45c6-a9cd-5a807fb0ad8f req-1188044c-02f3-4d58-879f-7cdf3e172021 service nova] Lock "37ba2c90-f471-4c24-ada2-084734722610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-6510c3cf-ecd4-45c6-a9cd-5a807fb0ad8f req-1188044c-02f3-4d58-879f-7cdf3e172021 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] No waiting events found dispatching network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:27 user nova-compute[73144]: WARNING nova.compute.manager [req-6510c3cf-ecd4-45c6-a9cd-5a807fb0ad8f req-1188044c-02f3-4d58-879f-7cdf3e172021 service nova] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Received unexpected event network-vif-plugged-648e988b-1d10-4829-932b-88c863dc0cfa for instance with vm_state active and task_state deleting.
Aug 14 22:03:28 user nova-compute[73144]: INFO nova.compute.manager [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Took 0.97 seconds to detach 1 volumes for instance.
Aug 14 22:03:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Deleting volume: 582a8584-1c29-4bc1-ab9a-fac4705091d2 {{(pid=73144) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 22:03:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:28 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:03:28 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:29 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Deleted allocations for instance 37ba2c90-f471-4c24-ada2-084734722610
Aug 14 22:03:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ed8c1cd6-0e27-49f4-bcc7-e190ced3ac88 tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "37ba2c90-f471-4c24-ada2-084734722610" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.123s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-changed-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Refreshing instance network info cache due to event network-changed-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] Acquiring lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] Acquired lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Refreshing network info cache for port 6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updated VIF entry in instance network info cache for port 6f34fee3-11e7-454d-b6c5-c8dbbd3b4551. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:03:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating instance_info_cache with network_info: [{"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-44b466cf-4f07-40e3-80d1-3f16ea02eb46 req-778dfdc1-09a4-4d32-a08b-c83667d8571f service nova] Releasing lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:36 user nova-compute[73144]: INFO nova.compute.manager [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attaching volume e4c71d93-fd73-479a-8cb4-56b958b1cd3d to /dev/vdb
Aug 14 22:03:36 user nova-compute[73144]: DEBUG os_brick.utils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4594c1e-6c68-4596-bd9e-e0f117ba8468]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc88db-46d2-4b64-b5ea-774a376a1cbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41b78f-da6b-4dea-8096-ad568c577f8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d5d2d3-a76d-4e12-afdb-55d06090afb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:03:36 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:03:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9b2de9-4905-48e2-83cb-af8554fcb609]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG os_brick.utils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:03:36 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating existing volume attachment record: 2d5467ac-cee0-4b72-8208-5a6279dd9a5a {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:03:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "793724d3-abe5-41ad-9711-4f31d009dea1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "793724d3-abe5-41ad-9711-4f31d009dea1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:03:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:39 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:03:39 user nova-compute[73144]: INFO nova.compute.claims [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Claim successful on node user
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:03:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:03:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:03:40 user nova-compute[73144]: INFO nova.virt.block_device [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Booting with volume snapshot c1619df6-1968-4961-b0bc-de77a230e8f6 at /dev/vda
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.policy [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a3e93f724b43a08ee42b79c63ed4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f796a65843b467a9889f47789c87eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050605.9294164, 37ba2c90-f471-4c24-ada2-084734722610 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:03:40 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 37ba2c90-f471-4c24-ada2-084734722610] VM Stopped (Lifecycle Event)
Aug 14 22:03:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ce6d40a8-2523-421b-9918-2b6c1dc81438 None None] [instance: 37ba2c90-f471-4c24-ada2-084734722610] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:03:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:41 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Successfully created port: 3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:03:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Successfully updated port: 3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "refresh_cache-793724d3-abe5-41ad-9711-4f31d009dea1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquired lock "refresh_cache-793724d3-abe5-41ad-9711-4f31d009dea1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received event network-changed-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.compute.manager [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Refreshing instance network info cache due to event network-changed-3a600806-5a60-48f7-b26e-a3ddb89487e1. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] Acquiring lock "refresh_cache-793724d3-abe5-41ad-9711-4f31d009dea1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Updating instance_info_cache with network_info: [{"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Releasing lock "refresh_cache-793724d3-abe5-41ad-9711-4f31d009dea1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Instance network_info: |[{"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] Acquired lock "refresh_cache-793724d3-abe5-41ad-9711-4f31d009dea1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Refreshing network info cache for port 3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Updated VIF entry in instance network info cache for port 3a600806-5a60-48f7-b26e-a3ddb89487e1. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG nova.network.neutron [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Updating instance_info_cache with network_info: [{"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:03:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50b4c62b-3a6e-4066-a5fe-c54658d3dc25 req-551ed517-d0ab-4653-9875-071125ebeca6 service nova] Releasing lock "refresh_cache-793724d3-abe5-41ad-9711-4f31d009dea1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:03:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.utils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf74130d-0913-4385-b78b-d86b501f578b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[148ee08a-5a44-4d30-8d4e-7be78777601e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d85b6-75c8-4b9e-943d-0df6e4324a11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9c8c7-2e8c-4c75-90ae-213b58b2e133]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:03:46 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85df2f9-b146-4a8a-bcb0-d9f640deb81d]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.utils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Updating existing volume attachment record: 6b889207-3214-4266-bcf0-56457af35abb {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOQXCZgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:03:46 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:03:46 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:03:46 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72bbee6-7368-4f4c-a798-286962a5b8bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:03:46 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a55d7-9528-42ff-bbab-ba0f57e67b33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d] added
Aug 14 22:03:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66bbcd0-6321-4b7b-8a9d-808bc34bab22]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f0bbb-6043-431a-b905-115f1781e9db]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOQXCZgb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOQXCZgb" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb586f7-3de5-4da7-828c-1b58810d7b5d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pOQXCZgb'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf616fb-d05d-47d1-8de8-178388f07444]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d219d6b-efb8-4a32-91bd-5d3b10495578]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569fa7b-713e-4f33-905f-0ab3204629e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260]
Aug 14 22:03:46 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260] successful.
Aug 14 22:03:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de3ede7-1ff3-4a34-a9a0-8f603eabb271]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6eacc6-b5d1-4731-aa61-a2e289f8785f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:03:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:46 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:03:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede9055-79d1-4bb5-b527-1d8642b6aed5]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOQXCZgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:03:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:03:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26666363465356466', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:03:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666363465356466', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:03:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:03:47 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:03:47 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:03:47 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:03:47 user nova-compute[73144]:   <serial>e4c71d93-fd73-479a-8cb4-56b958b1cd3d</serial>
Aug 14 22:03:47 user nova-compute[73144]: </disk>
Aug 14 22:03:47 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:03:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:03:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:03:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No VIF found with MAC fa:16:3e:98:44:55, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:03:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92b8ebb4-56ca-46b6-836c-abc56d7b9f49 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.578s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:03:55 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Creating image(s)
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Ensure instance console log exists: /opt/stack/data/nova/instances/793724d3-abe5-41ad-9711-4f31d009dea1/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Start _get_guest_xml network_info=[{"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '6b889207-3214-4266-bcf0-56457af35abb', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAaqPoeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '793724d3-abe5-41ad-9711-4f31d009dea1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef', 'serial': 'ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:03:55 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:03:55 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAaqPoeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:03:55 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:03:55 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:03:55 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f7f2d4-11eb-4511-885e-800f1fe4dc35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:03:55 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d3e26-b0d7-4465-b1bd-658d3ed74394]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef] added
Aug 14 22:03:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.117s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aec313-50bf-47c4-b46f-f0a43006543a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff5443-997b-41a1-9408-7e4ffcae3461]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAaqPoeG {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAaqPoeG" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a3e183-4984-4fed-a5c2-8fcbf7f6f09a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gAaqPoeG'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d281b-e13f-4276-8261-8b4da85f9459]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d431a3c-4197-4589-a3bf-ac4a0f6428aa]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:03:55 user nova-compute[73144]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)
Aug 14 22:03:55 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b14547-21a8-4a61-a3c4-d973b480f3fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260]
Aug 14 22:03:56 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260] successful.
Aug 14 22:03:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f028713-aa8e-4f61-b1a8-b8e655a59097]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b38bb3-938c-4b47-ac0c-d1616906e10d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:03:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)
Aug 14 22:03:56 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:03:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] HCTL ('39', '-', '-', 0) found on session 46 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b1f257-b287-415a-ab79-62819a6863bf]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching for a device in session 46 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:03:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAaqPoeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26635356134393361', 'path': '/dev/sdh'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635356134393361', 'path': '/dev/sdh'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1174461383',display_name='tempest-TestVolumeBootPattern-server-1174461383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1174461383',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-4ijyi2cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:03:40Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=793724d3-abe5-41ad-9711-4f31d009dea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:86:47,bridge_name='br-int',has_traffic_filtering=True,id=3a600806-5a60-48f7-b26e-a3ddb89487e1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a600806-5a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'pci_devices' on Instance uuid 793724d3-abe5-41ad-9711-4f31d009dea1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:03:57 user nova-compute[73144]:   <uuid>793724d3-abe5-41ad-9711-4f31d009dea1</uuid>
Aug 14 22:03:57 user nova-compute[73144]:   <name>instance-00000028</name>
Aug 14 22:03:57 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:03:57 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:03:57 user nova-compute[73144]:   <metadata>
Aug 14 22:03:57 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:03:57 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:03:57 user nova-compute[73144]:       <nova:name>tempest-TestVolumeBootPattern-server-1174461383</nova:name>
Aug 14 22:03:57 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:03:55</nova:creationTime>
Aug 14 22:03:57 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:03:57 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:03:57 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:03:57 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:03:57 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:03:57 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:03:57 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:03:57 user nova-compute[73144]:       <nova:owner>
Aug 14 22:03:57 user nova-compute[73144]:         <nova:user uuid="52a3e93f724b43a08ee42b79c63ed4d0">tempest-TestVolumeBootPattern-790116957-project-member</nova:user>
Aug 14 22:03:57 user nova-compute[73144]:         <nova:project uuid="0f796a65843b467a9889f47789c87eed">tempest-TestVolumeBootPattern-790116957</nova:project>
Aug 14 22:03:57 user nova-compute[73144]:       </nova:owner>
Aug 14 22:03:57 user nova-compute[73144]:       <nova:ports>
Aug 14 22:03:57 user nova-compute[73144]:         <nova:port uuid="3a600806-5a60-48f7-b26e-a3ddb89487e1">
Aug 14 22:03:57 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 22:03:57 user nova-compute[73144]:         </nova:port>
Aug 14 22:03:57 user nova-compute[73144]:       </nova:ports>
Aug 14 22:03:57 user nova-compute[73144]:     </nova:instance>
Aug 14 22:03:57 user nova-compute[73144]:   </metadata>
Aug 14 22:03:57 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:03:57 user nova-compute[73144]:     <system>
Aug 14 22:03:57 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:03:57 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:03:57 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:03:57 user nova-compute[73144]:       <entry name="serial">793724d3-abe5-41ad-9711-4f31d009dea1</entry>
Aug 14 22:03:57 user nova-compute[73144]:       <entry name="uuid">793724d3-abe5-41ad-9711-4f31d009dea1</entry>
Aug 14 22:03:57 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:03:57 user nova-compute[73144]:     </system>
Aug 14 22:03:57 user nova-compute[73144]:   </sysinfo>
Aug 14 22:03:57 user nova-compute[73144]:   <os>
Aug 14 22:03:57 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:03:57 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:03:57 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:03:57 user nova-compute[73144]:   </os>
Aug 14 22:03:57 user nova-compute[73144]:   <features>
Aug 14 22:03:57 user nova-compute[73144]:     <acpi/>
Aug 14 22:03:57 user nova-compute[73144]:     <apic/>
Aug 14 22:03:57 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:03:57 user nova-compute[73144]:   </features>
Aug 14 22:03:57 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:03:57 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:03:57 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:03:57 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:03:57 user nova-compute[73144]:   </clock>
Aug 14 22:03:57 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:03:57 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:03:57 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:03:57 user nova-compute[73144]:   </cpu>
Aug 14 22:03:57 user nova-compute[73144]:   <devices>
Aug 14 22:03:57 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:03:57 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:03:57 user nova-compute[73144]:       <source dev="/dev/sdh"/>
Aug 14 22:03:57 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:03:57 user nova-compute[73144]:       <serial>ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef</serial>
Aug 14 22:03:57 user nova-compute[73144]:     </disk>
Aug 14 22:03:57 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:03:57 user nova-compute[73144]:       <mac address="fa:16:3e:cd:86:47"/>
Aug 14 22:03:57 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:03:57 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:03:57 user nova-compute[73144]:       <target dev="tap3a600806-5a"/>
Aug 14 22:03:57 user nova-compute[73144]:     </interface>
Aug 14 22:03:57 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:03:57 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/793724d3-abe5-41ad-9711-4f31d009dea1/console.log" append="off"/>
Aug 14 22:03:57 user nova-compute[73144]:     </serial>
Aug 14 22:03:57 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:03:57 user nova-compute[73144]:     <video>
Aug 14 22:03:57 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:03:57 user nova-compute[73144]:     </video>
Aug 14 22:03:57 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:03:57 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:03:57 user nova-compute[73144]:     </rng>
Aug 14 22:03:57 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:03:57 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:03:57 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:03:57 user nova-compute[73144]:     </memballoon>
Aug 14 22:03:57 user nova-compute[73144]:   </devices>
Aug 14 22:03:57 user nova-compute[73144]: </domain>
Aug 14 22:03:57 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1174461383',display_name='tempest-TestVolumeBootPattern-server-1174461383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1174461383',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-4ijyi2cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:03:40Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=793724d3-abe5-41ad-9711-4f31d009dea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:86:47,bridge_name='br-int',has_traffic_filtering=True,id=3a600806-5a60-48f7-b26e-a3ddb89487e1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a600806-5a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG os_vif [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:86:47,bridge_name='br-int',has_traffic_filtering=True,id=3a600806-5a60-48f7-b26e-a3ddb89487e1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a600806-5a') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a600806-5a, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a600806-5a, col_values=(('external_ids', {'iface-id': '3a600806-5a60-48f7-b26e-a3ddb89487e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:86:47', 'vm-uuid': '793724d3-abe5-41ad-9711-4f31d009dea1'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:57 user nova-compute[73144]: INFO os_vif [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:86:47,bridge_name='br-int',has_traffic_filtering=True,id=3a600806-5a60-48f7-b26e-a3ddb89487e1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a600806-5a')
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:03:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No VIF found with MAC fa:16:3e:cd:86:47, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-0bb7e259-6da2-40da-9690-b9120695726d req-29d33de4-6fc5-4df1-99b8-3be660d101a5 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received event network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0bb7e259-6da2-40da-9690-b9120695726d req-29d33de4-6fc5-4df1-99b8-3be660d101a5 service nova] Acquiring lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0bb7e259-6da2-40da-9690-b9120695726d req-29d33de4-6fc5-4df1-99b8-3be660d101a5 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0bb7e259-6da2-40da-9690-b9120695726d req-29d33de4-6fc5-4df1-99b8-3be660d101a5 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:03:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-0bb7e259-6da2-40da-9690-b9120695726d req-29d33de4-6fc5-4df1-99b8-3be660d101a5 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] No waiting events found dispatching network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:03:58 user nova-compute[73144]: WARNING nova.compute.manager [req-0bb7e259-6da2-40da-9690-b9120695726d req-29d33de4-6fc5-4df1-99b8-3be660d101a5 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received unexpected event network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 for instance with vm_state building and task_state spawning.
Aug 14 22:03:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:03:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050640.700564, 793724d3-abe5-41ad-9711-4f31d009dea1 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:04:00 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] VM Resumed (Lifecycle Event)
Aug 14 22:04:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Instance spawned successfully.
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:04:00 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050640.7007923, 793724d3-abe5-41ad-9711-4f31d009dea1 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:04:00 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] VM Started (Lifecycle Event)
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:04:00 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:04:00 user nova-compute[73144]: INFO nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:04:00 user nova-compute[73144]: INFO nova.compute.manager [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Took 21.23 seconds to build instance.
Aug 14 22:04:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad65f289-67af-4631-9004-e29228830d52 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "793724d3-abe5-41ad-9711-4f31d009dea1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.354s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-594047a5-fa89-43ee-902f-7c47164f59ef req-bea6669a-a5f9-471d-924c-0b7e2dcf6b52 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received event network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-594047a5-fa89-43ee-902f-7c47164f59ef req-bea6669a-a5f9-471d-924c-0b7e2dcf6b52 service nova] Acquiring lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-594047a5-fa89-43ee-902f-7c47164f59ef req-bea6669a-a5f9-471d-924c-0b7e2dcf6b52 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-594047a5-fa89-43ee-902f-7c47164f59ef req-bea6669a-a5f9-471d-924c-0b7e2dcf6b52 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:00 user nova-compute[73144]: DEBUG nova.compute.manager [req-594047a5-fa89-43ee-902f-7c47164f59ef req-bea6669a-a5f9-471d-924c-0b7e2dcf6b52 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] No waiting events found dispatching network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:04:00 user nova-compute[73144]: WARNING nova.compute.manager [req-594047a5-fa89-43ee-902f-7c47164f59ef req-bea6669a-a5f9-471d-924c-0b7e2dcf6b52 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received unexpected event network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 for instance with vm_state active and task_state None.
Aug 14 22:04:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:13 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:04:13 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:04:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7366MB free_disk=24.915870666503906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:14 user nova-compute[73144]: INFO nova.compute.manager [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Detaching volume e4c71d93-fd73-479a-8cb4-56b958b1cd3d
Aug 14 22:04:14 user nova-compute[73144]: INFO nova.virt.block_device [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attempting to driver detach volume e4c71d93-fd73-479a-8cb4-56b958b1cd3d from mountpoint /dev/vdb
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Attempting to detach device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:04:14 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:04:14 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:04:14 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:04:14 user nova-compute[73144]:   <serial>e4c71d93-fd73-479a-8cb4-56b958b1cd3d</serial>
Aug 14 22:04:14 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:04:14 user nova-compute[73144]: </disk>
Aug 14 22:04:14 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:04:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config.
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:04:14 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:04:14 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:04:14 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:04:14 user nova-compute[73144]:   <serial>e4c71d93-fd73-479a-8cb4-56b958b1cd3d</serial>
Aug 14 22:04:14 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:04:14 user nova-compute[73144]: </disk>
Aug 14 22:04:14 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance b38d8d04-d91a-49d3-9350-e44d2ba576cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cbc94659-f76f-4b53-903b-60f59b0dfc55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c0cb840-2ddf-4a02-9a74-92339044bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 793724d3-abe5-41ad-9711-4f31d009dea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050654.5954018, e5f03cb8-f350-4e69-af26-1a40519be4da => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:04:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config.
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOQXCZgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:04:14 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[56716b2e-8a69-44a4-9f1d-33fe14b1452b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da939ac0-c76e-49a0-b652-037309245a7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa135b1-3479-46d6-9e47-7b768a4b34e9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da939ac0-c76e-49a0-b652-037309245a7a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da939ac0-c76e-49a0-b652-037309245a7a (non-flash)
Aug 14 22:04:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e11b6af-cd2d-4545-9b89-4d830eee6505 (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:04:14 user nova-compute[73144]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da939ac0-c76e-49a0-b652-037309245a7a (non-flash)
Aug 14 22:04:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa18c3e31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d090b37b-885f-4991-b4da-1f2e8c2cb866]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae2d163-f604-4a3e-8092-b18b7b149fef]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eda53e-3ab4-4a43-be8d-cd21f77a1250]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c026b8-4a0b-4e81-a259-f9da8381ed0d]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69ac84f-6adb-46c5-94e1-3bfcf843de1e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea02017-4526-4ff2-bbf3-7a3f6e411c9a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260]
Aug 14 22:04:14 user nova-compute[73144]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d, portal: 172.16.0.220,3260] successful.
Aug 14 22:04:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c71d93-fd73-479a-8cb4-56b958b1cd3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b095f03f-e9c8-4916-ab9c-69e07eaaedf8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== disconnect_volume: return (341ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:04:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:04:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:04:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-502c5d15-f08d-48db-9c61-df275a09a78c tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.180s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:16 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:16 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:04:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 22:04:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:04:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:22 user nova-compute[73144]: INFO nova.compute.manager [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Terminating instance
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-e4e3db2d-4535-4e84-a130-3fc5154d486f req-5f0e95ba-304e-4e15-b18a-7afd1c5e4d53 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-vif-unplugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e4e3db2d-4535-4e84-a130-3fc5154d486f req-5f0e95ba-304e-4e15-b18a-7afd1c5e4d53 service nova] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e4e3db2d-4535-4e84-a130-3fc5154d486f req-5f0e95ba-304e-4e15-b18a-7afd1c5e4d53 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e4e3db2d-4535-4e84-a130-3fc5154d486f req-5f0e95ba-304e-4e15-b18a-7afd1c5e4d53 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-e4e3db2d-4535-4e84-a130-3fc5154d486f req-5f0e95ba-304e-4e15-b18a-7afd1c5e4d53 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] No waiting events found dispatching network-vif-unplugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-e4e3db2d-4535-4e84-a130-3fc5154d486f req-5f0e95ba-304e-4e15-b18a-7afd1c5e4d53 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-vif-unplugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Instance destroyed successfully.
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lazy-loading 'resources' on Instance uuid b38d8d04-d91a-49d3-9350-e44d2ba576cf {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700950644',display_name='tempest-ServerActionsTestOtherA-server-700950644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700950644',id=6,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgVTXIZLieN/vuv+KzUz3FdyAVHDDhRYxpEMMC37E7x07twhQZDZ+QLfzLqeivlunXeXQdUFMTFOfvUuXB1Rd+PmOOZh9wvXd49uRwIdFmkJ50kKQFalHYCunzTwE1CCQ==',key_name='tempest-keypair-1585318650',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe2005f37baf4b1b99effc98fddd0fdc',ramdisk_id='',reservation_id='r-2tb4xrds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-202206255',owner_user_name='tempest-ServerActionsTestOtherA-202206255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f236788f6a93453b893ddf6d4cf01c1c',uuid=b38d8d04-d91a-49d3-9350-e44d2ba576cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converting VIF {"id": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "address": "fa:16:3e:38:87:eb", "network": {"id": "7cebdd29-2d8a-4acb-8dda-55aa66bb5c70", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1711782169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe2005f37baf4b1b99effc98fddd0fdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf601dc-0a", "ovs_interfaceid": "2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:87:eb,bridge_name='br-int',has_traffic_filtering=True,id=2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf601dc-0a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG os_vif [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:87:eb,bridge_name='br-int',has_traffic_filtering=True,id=2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf601dc-0a') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cf601dc-0a, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:04:22 user nova-compute[73144]: INFO os_vif [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:87:eb,bridge_name='br-int',has_traffic_filtering=True,id=2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09,network=Network(7cebdd29-2d8a-4acb-8dda-55aa66bb5c70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf601dc-0a')
Aug 14 22:04:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Deleting instance files /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf_del
Aug 14 22:04:22 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Deletion of /opt/stack/data/nova/instances/b38d8d04-d91a-49d3-9350-e44d2ba576cf_del complete
Aug 14 22:04:22 user nova-compute[73144]: INFO nova.compute.manager [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 14 22:04:22 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:04:22 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:04:23 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:04:23 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Took 0.70 seconds to deallocate network for instance.
Aug 14 22:04:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:24 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Deleted allocations for instance b38d8d04-d91a-49d3-9350-e44d2ba576cf
Aug 14 22:04:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-039ba7e7-6592-44cb-b8d6-87481b8013df tempest-ServerActionsTestOtherA-202206255 tempest-ServerActionsTestOtherA-202206255-project-member] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.013s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-33c2cbe6-15fc-4925-a6d3-87b4441837bd req-795ff2c9-2692-4cf2-807f-e0d6c934e1e4 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-33c2cbe6-15fc-4925-a6d3-87b4441837bd req-795ff2c9-2692-4cf2-807f-e0d6c934e1e4 service nova] Acquiring lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-33c2cbe6-15fc-4925-a6d3-87b4441837bd req-795ff2c9-2692-4cf2-807f-e0d6c934e1e4 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-33c2cbe6-15fc-4925-a6d3-87b4441837bd req-795ff2c9-2692-4cf2-807f-e0d6c934e1e4 service nova] Lock "b38d8d04-d91a-49d3-9350-e44d2ba576cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-33c2cbe6-15fc-4925-a6d3-87b4441837bd req-795ff2c9-2692-4cf2-807f-e0d6c934e1e4 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] No waiting events found dispatching network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:04:24 user nova-compute[73144]: WARNING nova.compute.manager [req-33c2cbe6-15fc-4925-a6d3-87b4441837bd req-795ff2c9-2692-4cf2-807f-e0d6c934e1e4 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received unexpected event network-vif-plugged-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 for instance with vm_state deleted and task_state None.
Aug 14 22:04:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-33c2cbe6-15fc-4925-a6d3-87b4441837bd req-795ff2c9-2692-4cf2-807f-e0d6c934e1e4 service nova] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Received event network-vif-deleted-2cf601dc-0aa9-40a6-9e45-ca7e3fba9c09 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:32 user nova-compute[73144]: INFO nova.compute.manager [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Rescuing
Aug 14 22:04:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:04:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:04:32 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:04:32 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Updating instance_info_cache with network_info: [{"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:04:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:04:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-83c4fc9e-55f0-465b-8658-b80860c0f3f0 req-02b8ac64-2391-4d0d-a701-845af480399e service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-83c4fc9e-55f0-465b-8658-b80860c0f3f0 req-02b8ac64-2391-4d0d-a701-845af480399e service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-83c4fc9e-55f0-465b-8658-b80860c0f3f0 req-02b8ac64-2391-4d0d-a701-845af480399e service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-83c4fc9e-55f0-465b-8658-b80860c0f3f0 req-02b8ac64-2391-4d0d-a701-845af480399e service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-83c4fc9e-55f0-465b-8658-b80860c0f3f0 req-02b8ac64-2391-4d0d-a701-845af480399e service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:04:33 user nova-compute[73144]: WARNING nova.compute.manager [req-83c4fc9e-55f0-465b-8658-b80860c0f3f0 req-02b8ac64-2391-4d0d-a701-845af480399e service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state active and task_state rescuing.
Aug 14 22:04:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:33 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance destroyed successfully.
Aug 14 22:04:33 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Attempting a stable device rescue
Aug 14 22:04:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73144) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance directory exists: not creating {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 22:04:33 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Creating image(s)
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "/opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "6ef90e99efe509c3d8782c43e184dc4313ab9593" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6ef90e99efe509c3d8782c43e184dc4313ab9593" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.part --force-share --output=json" returned: 0 in 0.467s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG nova.virt.images [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] 45b08791-de54-4fa4-bf6a-85bb193027c2 was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.part /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-dced12f3-7bc6-4103-b477-e5a579a3acac req-d93e5af2-a2aa-4f98-b6e5-0b5dd7ae94ee service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dced12f3-7bc6-4103-b477-e5a579a3acac req-d93e5af2-a2aa-4f98-b6e5-0b5dd7ae94ee service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dced12f3-7bc6-4103-b477-e5a579a3acac req-d93e5af2-a2aa-4f98-b6e5-0b5dd7ae94ee service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-dced12f3-7bc6-4103-b477-e5a579a3acac req-d93e5af2-a2aa-4f98-b6e5-0b5dd7ae94ee service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-dced12f3-7bc6-4103-b477-e5a579a3acac req-d93e5af2-a2aa-4f98-b6e5-0b5dd7ae94ee service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:04:35 user nova-compute[73144]: WARNING nova.compute.manager [req-dced12f3-7bc6-4103-b477-e5a579a3acac req-d93e5af2-a2aa-4f98-b6e5-0b5dd7ae94ee service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state active and task_state rescuing.
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.part /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.converted" returned: 0 in 0.758s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6ef90e99efe509c3d8782c43e184dc4313ab9593" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.564s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "6ef90e99efe509c3d8782c43e184dc4313ab9593" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6ef90e99efe509c3d8782c43e184dc4313ab9593" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing instance network info cache due to event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] Acquiring lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] Acquired lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.network.neutron [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593 --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593,backing_fmt=raw /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593,backing_fmt=raw /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue" returned: 0 in 0.058s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6ef90e99efe509c3d8782c43e184dc4313ab9593" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'migration_context' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Start _get_guest_xml network_info=[{"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "vif_mac": "fa:16:3e:c1:c6:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '45b08791-de54-4fa4-bf6a-85bb193027c2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '6a25054a-2327-41f2-8c2f-24115884c3eb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeclJjms', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '4c0cb840-2ddf-4a02-9a74-92339044bed4', 'attached_at': '', 'detached_at': '', 'volume_id': 'f084d871-c546-4c9f-8808-a8e3611341c0', 'serial': 'f084d871-c546-4c9f-8808-a8e3611341c0'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'resources' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:36 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:04:36 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeclJjms', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:04:36 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:04:36 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:04:36 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7dd3b9-e1c8-40ec-a824-27e8dc26b902]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EeclJjms\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 22:04:36 user nova-compute[73144]: node.name = iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0
Aug 14 22:04:36 user nova-compute[73144]: node.tpgt = -1
Aug 14 22:04:36 user nova-compute[73144]: node.startup = automatic
Aug 14 22:04:36 user nova-compute[73144]: node.leading_login = No
Aug 14 22:04:36 user nova-compute[73144]: iface.iscsi_ifacename = default
Aug 14 22:04:36 user nova-compute[73144]: iface.net_ifacename = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.ipaddress = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.prefix_len = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.hwaddress = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.transport_name = tcp
Aug 14 22:04:36 user nova-compute[73144]: iface.initiatorname = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.state = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.vlan_id = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.vlan_priority = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.vlan_state = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.iface_num = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.mtu = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.port = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.bootproto = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.subnet_mask = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.gateway = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_alt_client_id = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_dns = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_learn_iqn = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_vendor_id_state = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_vendor_id = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.dhcp_slp_da = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.fragmentation = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.gratuitous_arp = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.incoming_forwarding = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.tos_state = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.tos = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.ttl = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.delayed_ack = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.tcp_nagle = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.tcp_wsf_state = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.tcp_wsf = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.tcp_timer_scale = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.tcp_timestamp = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.redirect = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.def_task_mgmt_timeout = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.header_digest = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.data_digest = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.immediate_data = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.initial_r2t = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.data_seq_inorder = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.data_pdu_inorder = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.erl = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.max_receive_data_len = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.first_burst_len = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.max_outstanding_r2t = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.max_burst_len = 0
Aug 14 22:04:36 user nova-compute[73144]: iface.chap_auth = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.bidi_chap = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.strict_login_compliance = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.discovery_auth = <empty>
Aug 14 22:04:36 user nova-compute[73144]: iface.discovery_logout = <empty>
Aug 14 22:04:36 user nova-compute[73144]: node.discovery_address = <empty>
Aug 14 22:04:36 user nova-compute[73144]: node.discovery_port = 0
Aug 14 22:04:36 user nova-compute[73144]: node.discovery_type = static
Aug 14 22:04:36 user nova-compute[73144]: node.session.initial_cmdsn = 0
Aug 14 22:04:36 user nova-compute[73144]: node.session.initial_login_retry_max = 8
Aug 14 22:04:36 user nova-compute[73144]: node.session.xmit_thread_priority = -20
Aug 14 22:04:36 user nova-compute[73144]: node.session.cmds_max = 128
Aug 14 22:04:36 user nova-compute[73144]: node.session.queue_depth = 32
Aug 14 22:04:36 user nova-compute[73144]: node.session.nr_sessions = 1
Aug 14 22:04:36 user nova-compute[73144]: node.session.auth.authmethod = CHAP
Aug 14 22:04:36 user nova-compute[73144]: node.session.auth.username = EeclJjms
Aug 14 22:04:36 user nova-compute[73144]: node.session.auth.password = ***
Aug 14 22:04:36 user nova-compute[73144]: node.session.auth.username_in = <empty>
Aug 14 22:04:36 user nova-compute[73144]: node.session.auth.password_in = <empty>
Aug 14 22:04:36 user nova-compute[73144]: node.session.auth.chap_algs = MD5
Aug 14 22:04:36 user nova-compute[73144]: node.session.timeo.replacement_timeout = 120
Aug 14 22:04:36 user nova-compute[73144]: node.session.err_timeo.abort_timeout = 15
Aug 14 22:04:36 user nova-compute[73144]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 22:04:36 user nova-compute[73144]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 22:04:36 user nova-compute[73144]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.FastAbort = Yes
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.InitialR2T = No
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.ImmediateData = Yes
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.MaxConnections = 1
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 22:04:36 user nova-compute[73144]: node.session.iscsi.ERL = 0
Aug 14 22:04:36 user nova-compute[73144]: node.session.scan = manual
Aug 14 22:04:36 user nova-compute[73144]: node.session.reopen_max = 0
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].address = 172.16.0.220
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].port = 3260
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].startup = manual
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].tcp.window_size = 524288
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].tcp.type_of_service = 0
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].timeo.logout_timeout = 15
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].timeo.login_timeout = 15
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].timeo.auth_timeout = 45
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].iscsi.DataDigest = None
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].iscsi.IFMarker = No
Aug 14 22:04:36 user nova-compute[73144]: node.conn[0].iscsi.OFMarker = No
Aug 14 22:04:36 user nova-compute[73144]: # END RECORD
Aug 14 22:04:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d450be1-74d2-48a0-add7-4ed60832ebc5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[677cbd70-d863-47c6-9427-e50e5d98f393]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeclJjms {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeclJjms" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6077c3de-d168-4c30-99bd-8ca0293211ea]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EeclJjms'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f07a91-742b-4fc5-9205-cc8743670b99]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[61609c38-1b99-4faf-b07f-741a7dca3133]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:04:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:04:36 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:04:36 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] HCTL ('37', '0', '0', 0) found on session 43 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.network.neutron [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updated VIF entry in instance network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.network.neutron [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ac4757-58a4-4270-89a7-66aebdf599f4]: (4, ('0 0 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Searching for a device in session 43 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeclJjms', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '26438376536303732', 'path': '/dev/sdf'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438376536303732', 'path': '/dev/sdf'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-99aea0e6-090d-470b-8746-7ad5ecee7e6d req-968ae62e-c6f3-49a7-a9c3-70820b34af66 service nova] Releasing lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:02:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-537812427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-537812427',id=39,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:03:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-j7pgyuwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:03:20Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=4c0cb840-2ddf-4a02-9a74-92339044bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "vif_mac": "fa:16:3e:c1:c6:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "vif_mac": "fa:16:3e:c1:c6:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:04:36 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:04:37 user nova-compute[73144]:   <uuid>4c0cb840-2ddf-4a02-9a74-92339044bed4</uuid>
Aug 14 22:04:37 user nova-compute[73144]:   <name>instance-00000027</name>
Aug 14 22:04:37 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:04:37 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:04:37 user nova-compute[73144]:   <metadata>
Aug 14 22:04:37 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:04:37 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:04:37 user nova-compute[73144]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-537812427</nova:name>
Aug 14 22:04:37 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:04:36</nova:creationTime>
Aug 14 22:04:37 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:04:37 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:04:37 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:04:37 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:04:37 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:04:37 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:04:37 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:04:37 user nova-compute[73144]:       <nova:owner>
Aug 14 22:04:37 user nova-compute[73144]:         <nova:user uuid="cfe8b1fc0405438c99d3edd956e103a4">tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member</nova:user>
Aug 14 22:04:37 user nova-compute[73144]:         <nova:project uuid="59e45dfdc13e486e950f6bc8595bb8fa">tempest-ServerBootFromVolumeStableRescueTest-847208830</nova:project>
Aug 14 22:04:37 user nova-compute[73144]:       </nova:owner>
Aug 14 22:04:37 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:04:37 user nova-compute[73144]:       <nova:ports>
Aug 14 22:04:37 user nova-compute[73144]:         <nova:port uuid="529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f">
Aug 14 22:04:37 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 22:04:37 user nova-compute[73144]:         </nova:port>
Aug 14 22:04:37 user nova-compute[73144]:       </nova:ports>
Aug 14 22:04:37 user nova-compute[73144]:     </nova:instance>
Aug 14 22:04:37 user nova-compute[73144]:   </metadata>
Aug 14 22:04:37 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:04:37 user nova-compute[73144]:     <system>
Aug 14 22:04:37 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:04:37 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:04:37 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:04:37 user nova-compute[73144]:       <entry name="serial">4c0cb840-2ddf-4a02-9a74-92339044bed4</entry>
Aug 14 22:04:37 user nova-compute[73144]:       <entry name="uuid">4c0cb840-2ddf-4a02-9a74-92339044bed4</entry>
Aug 14 22:04:37 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:04:37 user nova-compute[73144]:     </system>
Aug 14 22:04:37 user nova-compute[73144]:   </sysinfo>
Aug 14 22:04:37 user nova-compute[73144]:   <os>
Aug 14 22:04:37 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:04:37 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:04:37 user nova-compute[73144]:   </os>
Aug 14 22:04:37 user nova-compute[73144]:   <features>
Aug 14 22:04:37 user nova-compute[73144]:     <acpi/>
Aug 14 22:04:37 user nova-compute[73144]:     <apic/>
Aug 14 22:04:37 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:04:37 user nova-compute[73144]:   </features>
Aug 14 22:04:37 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:04:37 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:04:37 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:04:37 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:04:37 user nova-compute[73144]:   </clock>
Aug 14 22:04:37 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:04:37 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:04:37 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:04:37 user nova-compute[73144]:   </cpu>
Aug 14 22:04:37 user nova-compute[73144]:   <devices>
Aug 14 22:04:37 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:04:37 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:04:37 user nova-compute[73144]:       <source dev="/dev/sdf"/>
Aug 14 22:04:37 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:04:37 user nova-compute[73144]:       <serial>f084d871-c546-4c9f-8808-a8e3611341c0</serial>
Aug 14 22:04:37 user nova-compute[73144]:     </disk>
Aug 14 22:04:37 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:04:37 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:04:37 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue"/>
Aug 14 22:04:37 user nova-compute[73144]:       <target dev="vdb" bus="virtio"/>
Aug 14 22:04:37 user nova-compute[73144]:       <boot order="1"/>
Aug 14 22:04:37 user nova-compute[73144]:     </disk>
Aug 14 22:04:37 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:04:37 user nova-compute[73144]:       <mac address="fa:16:3e:c1:c6:28"/>
Aug 14 22:04:37 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:04:37 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:04:37 user nova-compute[73144]:       <target dev="tap529f9817-6a"/>
Aug 14 22:04:37 user nova-compute[73144]:     </interface>
Aug 14 22:04:37 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:04:37 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/console.log" append="off"/>
Aug 14 22:04:37 user nova-compute[73144]:     </serial>
Aug 14 22:04:37 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:04:37 user nova-compute[73144]:     <video>
Aug 14 22:04:37 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:04:37 user nova-compute[73144]:     </video>
Aug 14 22:04:37 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:04:37 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:04:37 user nova-compute[73144]:     </rng>
Aug 14 22:04:37 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:04:37 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:04:37 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:04:37 user nova-compute[73144]:     </memballoon>
Aug 14 22:04:37 user nova-compute[73144]:   </devices>
Aug 14 22:04:37 user nova-compute[73144]: </domain>
Aug 14 22:04:37 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:04:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance destroyed successfully.
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] No VIF found with MAC fa:16:3e:c1:c6:28, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:37 user nova-compute[73144]: INFO nova.compute.manager [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Detaching volume 73678973-2507-452c-90a3-f6c2e0c3dbb2
Aug 14 22:04:37 user nova-compute[73144]: INFO nova.virt.block_device [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Attempting to driver detach volume 73678973-2507-452c-90a3-f6c2e0c3dbb2 from mountpoint /dev/vdb
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Attempting to detach device vdb from instance cbc94659-f76f-4b53-903b-60f59b0dfc55 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:04:37 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:04:37 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 22:04:37 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:04:37 user nova-compute[73144]:   <serial>73678973-2507-452c-90a3-f6c2e0c3dbb2</serial>
Aug 14 22:04:37 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 22:04:37 user nova-compute[73144]: </disk>
Aug 14 22:04:37 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:04:37 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully detached device vdb from instance cbc94659-f76f-4b53-903b-60f59b0dfc55 from the persistent domain config.
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cbc94659-f76f-4b53-903b-60f59b0dfc55 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:04:37 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:04:37 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 22:04:37 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:04:37 user nova-compute[73144]:   <serial>73678973-2507-452c-90a3-f6c2e0c3dbb2</serial>
Aug 14 22:04:37 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 22:04:37 user nova-compute[73144]: </disk>
Aug 14 22:04:37 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050662.820517, b38d8d04-d91a-49d3-9350-e44d2ba576cf => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:04:37 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] VM Stopped (Lifecycle Event)
Aug 14 22:04:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-de532cb8-e33f-4f5e-8bc1-51780c8c1254 None None] [instance: b38d8d04-d91a-49d3-9350-e44d2ba576cf] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:04:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050678.395679, cbc94659-f76f-4b53-903b-60f59b0dfc55 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:04:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully detached device vdb from instance cbc94659-f76f-4b53-903b-60f59b0dfc55 from the live domain config.
Aug 14 22:04:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYIAgUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:04:38 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing instance network info cache due to event network-changed-e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] Acquiring lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] Acquired lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Refreshing network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f475a73e-70bd-4836-8c95-fbf165c39854]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1928ba-0fa0-439b-b5a8-53ecc4852ccc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:04:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:04:38 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:04:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586a8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b84dc-2119-43e5-9422-bb879632c86c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c79281-15bd-4748-bbbf-12cd568835f0]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3306348-ab02-4721-8aec-b86dddf8a83d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53ca00-bd83-4e9f-ab39-9b4938fea528]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3222bba0-43c6-4efe-bb40-9e3bbcf94193]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796969e-e84c-4743-9b00-19058b535284]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260]
Aug 14 22:04:38 user nova-compute[73144]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2, portal: 172.16.0.220,3260] successful.
Aug 14 22:04:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73678973-2507-452c-90a3-f6c2e0c3dbb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d83f916-9d61-49b6-a075-0914961ac505]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== disconnect_volume: return (342ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-50fd0014-6e02-4421-ae28-343fde5bebdd req-3d369c4c-3e93-4022-b05a-123a9a328082 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50fd0014-6e02-4421-ae28-343fde5bebdd req-3d369c4c-3e93-4022-b05a-123a9a328082 service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50fd0014-6e02-4421-ae28-343fde5bebdd req-3d369c4c-3e93-4022-b05a-123a9a328082 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50fd0014-6e02-4421-ae28-343fde5bebdd req-3d369c4c-3e93-4022-b05a-123a9a328082 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-50fd0014-6e02-4421-ae28-343fde5bebdd req-3d369c4c-3e93-4022-b05a-123a9a328082 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:04:39 user nova-compute[73144]: WARNING nova.compute.manager [req-50fd0014-6e02-4421-ae28-343fde5bebdd req-3d369c4c-3e93-4022-b05a-123a9a328082 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state active and task_state rescuing.
Aug 14 22:04:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updated VIF entry in instance network info cache for port e11dc58f-a416-43a7-b0b9-73ee1dd7382d. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [{"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e847a9f6-fedb-4408-836c-18994b094542 req-eedaae1e-46c5-4101-b61e-45b5adf26d28 service nova] Releasing lock "refresh_cache-cbc94659-f76f-4b53-903b-60f59b0dfc55" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG nova.objects.instance [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'flavor' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:04:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-7bce869a-f6b5-4b29-ae38-51958bae1085 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.119s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for 4c0cb840-2ddf-4a02-9a74-92339044bed4 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 22:04:40 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050680.9565756, 4c0cb840-2ddf-4a02-9a74-92339044bed4 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:04:40 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] VM Resumed (Lifecycle Event)
Aug 14 22:04:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1d7dc15a-35b5-4c68-9a4c-9aa1dc25f3ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:04:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:04:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:04:41 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 22:04:41 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050680.9575849, 4c0cb840-2ddf-4a02-9a74-92339044bed4 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:04:41 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] VM Started (Lifecycle Event)
Aug 14 22:04:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:04:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:04:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc151d26-5ff6-4886-b624-525230f4ed1d req-32c65e38-efd6-4902-b397-1deb01e38a4c service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:04:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc151d26-5ff6-4886-b624-525230f4ed1d req-32c65e38-efd6-4902-b397-1deb01e38a4c service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:04:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc151d26-5ff6-4886-b624-525230f4ed1d req-32c65e38-efd6-4902-b397-1deb01e38a4c service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:04:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc151d26-5ff6-4886-b624-525230f4ed1d req-32c65e38-efd6-4902-b397-1deb01e38a4c service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:04:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc151d26-5ff6-4886-b624-525230f4ed1d req-32c65e38-efd6-4902-b397-1deb01e38a4c service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:04:41 user nova-compute[73144]: WARNING nova.compute.manager [req-bc151d26-5ff6-4886-b624-525230f4ed1d req-32c65e38-efd6-4902-b397-1deb01e38a4c service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state rescued and task_state None.
Aug 14 22:04:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:04:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:04:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:04:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:04:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:04:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:01 user nova-compute[73144]: INFO nova.compute.manager [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Unshelving
Aug 14 22:05:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:01 user nova-compute[73144]: DEBUG nova.objects.instance [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'pci_requests' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:01 user nova-compute[73144]: DEBUG nova.objects.instance [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'numa_topology' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:01 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:05:01 user nova-compute[73144]: INFO nova.compute.claims [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Claim successful on node user
Aug 14 22:05:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:02 user nova-compute[73144]: INFO nova.network.neutron [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating port cebad443-da70-41b3-aaee-7f539f336c43 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquired lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG nova.network.neutron [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-changed-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG nova.compute.manager [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing instance network info cache due to event network-changed-cebad443-da70-41b3-aaee-7f539f336c43. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:05:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] Acquiring lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG nova.network.neutron [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Releasing lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:05:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Creating image(s)
Aug 14 22:05:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG nova.objects.instance [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] Acquired lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG nova.network.neutron [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Refreshing network info cache for port cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "a91c83a23022c5867fc15cfd177b9ef045b18d2e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a91c83a23022c5867fc15cfd177b9ef045b18d2e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.part --force-share --output=json" returned: 0 in 0.210s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG nova.virt.images [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] c11dc728-94fb-40c8-8daf-f38cb64608b2 was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.part /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG nova.network.neutron [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updated VIF entry in instance network info cache for port cebad443-da70-41b3-aaee-7f539f336c43. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG nova.network.neutron [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.part /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.converted" returned: 0 in 0.281s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d3bc933f-ee28-46d8-aa39-abad44602211 req-63736ae5-0e74-4e61-86a3-3db634577c62 service nova] Releasing lock "refresh_cache-8098d577-b7b2-4881-aa10-5cca7f5ee0f1" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a91c83a23022c5867fc15cfd177b9ef045b18d2e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.597s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e --force-share --output=json" returned: 0 in 0.218s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "a91c83a23022c5867fc15cfd177b9ef045b18d2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a91c83a23022c5867fc15cfd177b9ef045b18d2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e --force-share --output=json" returned: 0 in 0.232s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e,backing_fmt=raw /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e,backing_fmt=raw /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk 1073741824" returned: 0 in 0.058s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "a91c83a23022c5867fc15cfd177b9ef045b18d2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e --force-share --output=json" returned: 0 in 0.224s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG nova.objects.instance [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'migration_context' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:05 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Rebasing disk image.
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:05 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 -F raw /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.objects.instance [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 -F raw /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk" returned: 0 in 2.299s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Ensure instance console log exists: /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Start _get_guest_xml network_info=[{"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ede69c5853190fe9d04ff11b2ac1fa8f',container_format='bare',created_at=2023-08-14T22:03:09Z,direct_url=<?>,disk_format='qcow2',id=c11dc728-94fb-40c8-8daf-f38cb64608b2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1260519476-shelved',owner='69745a6a4d3345fcb143da4f825a2100',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T22:03:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:05:08 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:05:08 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ede69c5853190fe9d04ff11b2ac1fa8f',container_format='bare',created_at=2023-08-14T22:03:09Z,direct_url=<?>,disk_format='qcow2',id=c11dc728-94fb-40c8-8daf-f38cb64608b2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1260519476-shelved',owner='69745a6a4d3345fcb143da4f825a2100',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T22:03:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.objects.instance [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1260519476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1260519476',id=37,image_ref='c11dc728-94fb-40c8-8daf-f38cb64608b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1868290249',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-r0cqfhri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member',shelved_at='2023-08-14T22:03:13.169778',shelved_host='user',shelved_image_id='c11dc728-94fb-40c8-8daf-f38cb64608b2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=8098d577-b7b2-4881-aa10-5cca7f5ee0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.objects.instance [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'pci_devices' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:05:08 user nova-compute[73144]:   <uuid>8098d577-b7b2-4881-aa10-5cca7f5ee0f1</uuid>
Aug 14 22:05:08 user nova-compute[73144]:   <name>instance-00000025</name>
Aug 14 22:05:08 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:05:08 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:05:08 user nova-compute[73144]:   <metadata>
Aug 14 22:05:08 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:05:08 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:05:08 user nova-compute[73144]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1260519476</nova:name>
Aug 14 22:05:08 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:05:08</nova:creationTime>
Aug 14 22:05:08 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:05:08 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:05:08 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:05:08 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:05:08 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:05:08 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:05:08 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:05:08 user nova-compute[73144]:       <nova:owner>
Aug 14 22:05:08 user nova-compute[73144]:         <nova:user uuid="11172444b2d54c0dae51f822168f586a">tempest-AttachVolumeShelveTestJSON-1156240232-project-member</nova:user>
Aug 14 22:05:08 user nova-compute[73144]:         <nova:project uuid="69745a6a4d3345fcb143da4f825a2100">tempest-AttachVolumeShelveTestJSON-1156240232</nova:project>
Aug 14 22:05:08 user nova-compute[73144]:       </nova:owner>
Aug 14 22:05:08 user nova-compute[73144]:       <nova:root type="image" uuid="c11dc728-94fb-40c8-8daf-f38cb64608b2"/>
Aug 14 22:05:08 user nova-compute[73144]:       <nova:ports>
Aug 14 22:05:08 user nova-compute[73144]:         <nova:port uuid="cebad443-da70-41b3-aaee-7f539f336c43">
Aug 14 22:05:08 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:05:08 user nova-compute[73144]:         </nova:port>
Aug 14 22:05:08 user nova-compute[73144]:       </nova:ports>
Aug 14 22:05:08 user nova-compute[73144]:     </nova:instance>
Aug 14 22:05:08 user nova-compute[73144]:   </metadata>
Aug 14 22:05:08 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:05:08 user nova-compute[73144]:     <system>
Aug 14 22:05:08 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:05:08 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:05:08 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:05:08 user nova-compute[73144]:       <entry name="serial">8098d577-b7b2-4881-aa10-5cca7f5ee0f1</entry>
Aug 14 22:05:08 user nova-compute[73144]:       <entry name="uuid">8098d577-b7b2-4881-aa10-5cca7f5ee0f1</entry>
Aug 14 22:05:08 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:05:08 user nova-compute[73144]:     </system>
Aug 14 22:05:08 user nova-compute[73144]:   </sysinfo>
Aug 14 22:05:08 user nova-compute[73144]:   <os>
Aug 14 22:05:08 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:05:08 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:05:08 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:05:08 user nova-compute[73144]:   </os>
Aug 14 22:05:08 user nova-compute[73144]:   <features>
Aug 14 22:05:08 user nova-compute[73144]:     <acpi/>
Aug 14 22:05:08 user nova-compute[73144]:     <apic/>
Aug 14 22:05:08 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:05:08 user nova-compute[73144]:   </features>
Aug 14 22:05:08 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:05:08 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:05:08 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:05:08 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:05:08 user nova-compute[73144]:   </clock>
Aug 14 22:05:08 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:05:08 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:05:08 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:05:08 user nova-compute[73144]:   </cpu>
Aug 14 22:05:08 user nova-compute[73144]:   <devices>
Aug 14 22:05:08 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:05:08 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:05:08 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk"/>
Aug 14 22:05:08 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:05:08 user nova-compute[73144]:     </disk>
Aug 14 22:05:08 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:05:08 user nova-compute[73144]:       <mac address="fa:16:3e:32:11:d9"/>
Aug 14 22:05:08 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:05:08 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:05:08 user nova-compute[73144]:       <target dev="tapcebad443-da"/>
Aug 14 22:05:08 user nova-compute[73144]:     </interface>
Aug 14 22:05:08 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:05:08 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/console.log" append="off"/>
Aug 14 22:05:08 user nova-compute[73144]:     </serial>
Aug 14 22:05:08 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:05:08 user nova-compute[73144]:     <video>
Aug 14 22:05:08 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:05:08 user nova-compute[73144]:     </video>
Aug 14 22:05:08 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:05:08 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:05:08 user nova-compute[73144]:     </rng>
Aug 14 22:05:08 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:05:08 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:05:08 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:05:08 user nova-compute[73144]:     </memballoon>
Aug 14 22:05:08 user nova-compute[73144]:   </devices>
Aug 14 22:05:08 user nova-compute[73144]: </domain>
Aug 14 22:05:08 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1260519476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1260519476',id=37,image_ref='c11dc728-94fb-40c8-8daf-f38cb64608b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1868290249',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-r0cqfhri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member',shelved_at='2023-08-14T22:03:13.169778',shelved_host='user',shelved_image_id='c11dc728-94fb-40c8-8daf-f38cb64608b2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=8098d577-b7b2-4881-aa10-5cca7f5ee0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG os_vif [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:08 user nova-compute[73144]: INFO nova.compute.manager [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attaching volume 7bc00847-36a8-4332-b178-10a0af97d743 to /dev/vdb
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcebad443-da, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcebad443-da, col_values=(('external_ids', {'iface-id': 'cebad443-da70-41b3-aaee-7f539f336c43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:11:d9', 'vm-uuid': '8098d577-b7b2-4881-aa10-5cca7f5ee0f1'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:08 user nova-compute[73144]: INFO os_vif [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da')
Aug 14 22:05:08 user nova-compute[73144]: DEBUG os_brick.utils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] No VIF found with MAC fa:16:3e:32:11:d9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e893b52-7f0d-41f8-a687-bcc927f4bd56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[92542830-852f-48f6-bbb9-44c46931f4bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[482543e5-abbd-4076-a110-7173631765cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[13906e81-4d9e-4e91-ac6e-fa2fc1cf0f77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:05:08 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:05:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43d352-6576-4def-b92c-3e5327a6fac8]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG os_brick.utils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== get_connector_properties: return (289ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:05:08 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating existing volume attachment record: 754b2656-0e24-449a-87de-9dbc3117b0ae {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:05:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing instance network info cache due to event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] Acquiring lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] Acquired lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.network.neutron [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-5ab9ccaa-4f9f-44a2-9357-6752318992be req-488b190d-691b-4954-bd07-52044029546a service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5ab9ccaa-4f9f-44a2-9357-6752318992be req-488b190d-691b-4954-bd07-52044029546a service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5ab9ccaa-4f9f-44a2-9357-6752318992be req-488b190d-691b-4954-bd07-52044029546a service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5ab9ccaa-4f9f-44a2-9357-6752318992be req-488b190d-691b-4954-bd07-52044029546a service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-5ab9ccaa-4f9f-44a2-9357-6752318992be req-488b190d-691b-4954-bd07-52044029546a service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:10 user nova-compute[73144]: WARNING nova.compute.manager [req-5ab9ccaa-4f9f-44a2-9357-6752318992be req-488b190d-691b-4954-bd07-52044029546a service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received unexpected event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 22:05:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.network.neutron [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updated VIF entry in instance network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG nova.network.neutron [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5ade227f-e226-42d6-b7e2-323a444419ba req-fbde25ca-9cb0-4cf9-a6e0-2410d7540e43 service nova] Releasing lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:11 user nova-compute[73144]: INFO nova.compute.manager [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Detaching volume cb8f28dc-a84b-41e5-930d-ed39745a7bc3
Aug 14 22:05:11 user nova-compute[73144]: INFO nova.virt.block_device [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Attempting to driver detach volume cb8f28dc-a84b-41e5-930d-ed39745a7bc3 from mountpoint /dev/vdb
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Attempting to detach device vdb from instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:05:11 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:05:11 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:05:11 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:05:11 user nova-compute[73144]:   <serial>cb8f28dc-a84b-41e5-930d-ed39745a7bc3</serial>
Aug 14 22:05:11 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:05:11 user nova-compute[73144]: </disk>
Aug 14 22:05:11 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:05:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully detached device vdb from instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 from the persistent domain config.
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:05:11 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:05:11 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:05:11 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:05:11 user nova-compute[73144]:   <serial>cb8f28dc-a84b-41e5-930d-ed39745a7bc3</serial>
Aug 14 22:05:11 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:05:11 user nova-compute[73144]: </disk>
Aug 14 22:05:11 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050711.7547374, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:05:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully detached device vdb from instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 from the live domain config.
Aug 14 22:05:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVDMxoOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:05:11 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3867352-8862-4bd1-bd2e-8f94db9ab26b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a44a740-1262-4b2b-8356-389f95712645]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:11 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:05:11 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:11 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:11 user nova-compute[73144]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 (non-flash)
Aug 14 22:05:11 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:11 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17872bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1694add-1d4b-4152-b7a0-33ac86120800]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a85070-709e-456c-ba9a-500a89f7bfef]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ca7b6-3ca6-4b93-8d09-1edbe14e1f1a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f390a8fd-a528-4f47-9974-27eec036135d]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[267ea573-28ce-408e-867b-1bb275d85942]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.167s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b29cb9-0933-4522-9325-51c6485176f0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260]
Aug 14 22:05:12 user nova-compute[73144]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3, portal: 172.16.0.220,3260] successful.
Aug 14 22:05:12 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f28dc-a84b-41e5-930d-ed39745a7bc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd067f3-3f50-47c6-baa5-08809919593a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] <== disconnect_volume: return (410ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing instance network info cache due to event network-changed-b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] Acquiring lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] Acquired lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Refreshing network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050712.3630025, 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:05:12 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] VM Resumed (Lifecycle Event)
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:05:12 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance spawned successfully.
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-c1c2225e-1b0c-4efa-8199-daeaa40b3b55 req-e0467a19-9706-41b4-b10f-b47b36b7ef13 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c1c2225e-1b0c-4efa-8199-daeaa40b3b55 req-e0467a19-9706-41b4-b10f-b47b36b7ef13 service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c1c2225e-1b0c-4efa-8199-daeaa40b3b55 req-e0467a19-9706-41b4-b10f-b47b36b7ef13 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c1c2225e-1b0c-4efa-8199-daeaa40b3b55 req-e0467a19-9706-41b4-b10f-b47b36b7ef13 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-c1c2225e-1b0c-4efa-8199-daeaa40b3b55 req-e0467a19-9706-41b4-b10f-b47b36b7ef13 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:12 user nova-compute[73144]: WARNING nova.compute.manager [req-c1c2225e-1b0c-4efa-8199-daeaa40b3b55 req-e0467a19-9706-41b4-b10f-b47b36b7ef13 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received unexpected event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 22:05:12 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050712.3660102, 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:05:12 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] VM Started (Lifecycle Event)
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:05:12 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-add9c29f-68f4-4fa7-a97e-54756bec42fe tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.166s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updated VIF entry in instance network info cache for port b484bc7b-fb19-4a51-ab9b-aafb744e31ff. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [{"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c388d92a-4c85-4fa4-b68f-1e611365f5d0 req-727c0d78-dee5-470e-a848-b55608ab7a55 service nova] Releasing lock "refresh_cache-f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG nova.objects.instance [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'flavor' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-84f05ff4-7bcc-4c77-9107-81e699608a56 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.077s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:05:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=24.714427947998047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cbc94659-f76f-4b53-903b-60f59b0dfc55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c0cb840-2ddf-4a02-9a74-92339044bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 793724d3-abe5-41ad-9711-4f31d009dea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:05:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShNaiYxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:05:18 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:05:18 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:05:18 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eb4aac-8172-4eb6-b682-370be1eed799]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:05:18 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2efa6-2895-4c25-bc3c-38017f76d6cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743] added
Aug 14 22:05:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca4546d-049f-4d7f-a160-ab4293701f5a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4be8d-dc92-400c-b3e5-af12369941c8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShNaiYxZ {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShNaiYxZ" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faca0b3-1452-4458-b9d2-d83be3cab4f3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShNaiYxZ'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e98ae4-eeda-4638-87a4-4f00df5ad80e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb8093-895f-4d8c-ab51-93dcb34615fd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33fd776-83cd-4bd0-9f9e-a9b40da3841a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260]
Aug 14 22:05:18 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260] successful.
Aug 14 22:05:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[98524b0a-acb2-43d2-a566-859aabc56e82]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e3674-93af-4601-95dc-ad4aa3614e3d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:18 user nova-compute[73144]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 (non-flash)
Aug 14 22:05:18 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d5680-27bb-4ad4-bdc7-cd18b388437b]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:05:18 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShNaiYxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid 6f7f7181-df25-4e9a-b990-251cabf0129c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updating instance_info_cache with network_info: [{"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-6f7f7181-df25-4e9a-b990-251cabf0129c" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26536386466393333', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536386466393333', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG nova.objects.instance [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:05:19 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:05:19 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:05:19 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:05:19 user nova-compute[73144]:   <serial>7bc00847-36a8-4332-b178-10a0af97d743</serial>
Aug 14 22:05:19 user nova-compute[73144]: </disk>
Aug 14 22:05:19 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:05:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:05:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:05:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No VIF found with MAC fa:16:3e:98:44:55, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:05:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-97f5a00f-10ca-4571-a107-982ea98e66c5 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.254s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:05:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:23 user nova-compute[73144]: INFO nova.compute.manager [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Detaching volume 7bc00847-36a8-4332-b178-10a0af97d743
Aug 14 22:05:23 user nova-compute[73144]: INFO nova.virt.block_device [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attempting to driver detach volume 7bc00847-36a8-4332-b178-10a0af97d743 from mountpoint /dev/vdb
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Attempting to detach device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:05:23 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:05:23 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:05:23 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:05:23 user nova-compute[73144]:   <serial>7bc00847-36a8-4332-b178-10a0af97d743</serial>
Aug 14 22:05:23 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:05:23 user nova-compute[73144]: </disk>
Aug 14 22:05:23 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:05:23 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config.
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:05:23 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:05:23 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:05:23 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:05:23 user nova-compute[73144]:   <serial>7bc00847-36a8-4332-b178-10a0af97d743</serial>
Aug 14 22:05:23 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:05:23 user nova-compute[73144]: </disk>
Aug 14 22:05:23 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050723.5621397, e5f03cb8-f350-4e69-af26-1a40519be4da => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:05:23 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config.
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShNaiYxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:05:23 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c486c-dab1-47eb-972b-8808e57b8691]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e6ef88-8489-417f-a44e-061e86e2a6a6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:23 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:23 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:23 user nova-compute[73144]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 (non-flash)
Aug 14 22:05:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:23 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:23 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:23 user nova-compute[73144]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 (non-flash)
Aug 14 22:05:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17850beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[363405d7-d8e7-41e1-92cb-2d463f55a53e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c05136c-aeff-4e59-b0e3-5e0edf6ff4b2]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[44891b70-09fb-4833-a9f2-65cc70158b07]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bda123-133d-4f09-83c2-ab8f01a4997a]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e68db1d-56c8-46b0-b035-976bdd1a06f4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95a0ec6-bfda-468c-82fd-ba377d12f2a2]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260]
Aug 14 22:05:23 user nova-compute[73144]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743, portal: 172.16.0.220,3260] successful.
Aug 14 22:05:23 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc00847-36a8-4332-b178-10a0af97d743 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ebab1d-ac8b-4c99-943b-8e7e52f7addb]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== disconnect_volume: return (307ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:05:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:05:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-aa571fe2-4898-441f-92b2-ee0573b72167 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:05:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:26 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:05:26 user nova-compute[73144]: INFO nova.compute.claims [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Claim successful on node user
Aug 14 22:05:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:05:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.policy [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43342fae8732443c990af06487af5c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17398a626e67472e81402db4abe498e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:05:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Creating image(s)
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "/opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "/opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.205s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk 1073741824" returned: 0 in 0.055s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:27 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Successfully created port: 86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Cannot resize image /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lazy-loading 'migration_context' on Instance uuid 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Ensure instance console log exists: /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Successfully updated port: 86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquired lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received event network-changed-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Refreshing instance network info cache due to event network-changed-86eba6fd-e57e-4530-b80f-d966b2db71af. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] Acquiring lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:05:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updating instance_info_cache with network_info: [{"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Releasing lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Instance network_info: |[{"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] Acquired lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Refreshing network info cache for port 86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Start _get_guest_xml network_info=[{"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:05:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:05:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-69473342',display_name='tempest-ServersNegativeTestJSON-server-69473342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-69473342',id=41,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17398a626e67472e81402db4abe498e1',ramdisk_id='',reservation_id='r-o9pw83o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712834715',owner_user_name='tempest-ServersNegativeTestJSON-1712834715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:05:27Z,user_data=None,user_id='43342fae8732443c990af06487af5c0b',uuid=9e9d6b63-cc96-431f-ab2f-733809ffdcb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converting VIF {"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=86eba6fd-e57e-4530-b80f-d966b2db71af,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eba6fd-e5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:05:29 user nova-compute[73144]:   <uuid>9e9d6b63-cc96-431f-ab2f-733809ffdcb3</uuid>
Aug 14 22:05:29 user nova-compute[73144]:   <name>instance-00000029</name>
Aug 14 22:05:29 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:05:29 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:05:29 user nova-compute[73144]:   <metadata>
Aug 14 22:05:29 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:05:29 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:05:29 user nova-compute[73144]:       <nova:name>tempest-ServersNegativeTestJSON-server-69473342</nova:name>
Aug 14 22:05:29 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:05:29</nova:creationTime>
Aug 14 22:05:29 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:05:29 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:05:29 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:05:29 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:05:29 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:05:29 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:05:29 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:05:29 user nova-compute[73144]:       <nova:owner>
Aug 14 22:05:29 user nova-compute[73144]:         <nova:user uuid="43342fae8732443c990af06487af5c0b">tempest-ServersNegativeTestJSON-1712834715-project-member</nova:user>
Aug 14 22:05:29 user nova-compute[73144]:         <nova:project uuid="17398a626e67472e81402db4abe498e1">tempest-ServersNegativeTestJSON-1712834715</nova:project>
Aug 14 22:05:29 user nova-compute[73144]:       </nova:owner>
Aug 14 22:05:29 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:05:29 user nova-compute[73144]:       <nova:ports>
Aug 14 22:05:29 user nova-compute[73144]:         <nova:port uuid="86eba6fd-e57e-4530-b80f-d966b2db71af">
Aug 14 22:05:29 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 22:05:29 user nova-compute[73144]:         </nova:port>
Aug 14 22:05:29 user nova-compute[73144]:       </nova:ports>
Aug 14 22:05:29 user nova-compute[73144]:     </nova:instance>
Aug 14 22:05:29 user nova-compute[73144]:   </metadata>
Aug 14 22:05:29 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:05:29 user nova-compute[73144]:     <system>
Aug 14 22:05:29 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:05:29 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:05:29 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:05:29 user nova-compute[73144]:       <entry name="serial">9e9d6b63-cc96-431f-ab2f-733809ffdcb3</entry>
Aug 14 22:05:29 user nova-compute[73144]:       <entry name="uuid">9e9d6b63-cc96-431f-ab2f-733809ffdcb3</entry>
Aug 14 22:05:29 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:05:29 user nova-compute[73144]:     </system>
Aug 14 22:05:29 user nova-compute[73144]:   </sysinfo>
Aug 14 22:05:29 user nova-compute[73144]:   <os>
Aug 14 22:05:29 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:05:29 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:05:29 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:05:29 user nova-compute[73144]:   </os>
Aug 14 22:05:29 user nova-compute[73144]:   <features>
Aug 14 22:05:29 user nova-compute[73144]:     <acpi/>
Aug 14 22:05:29 user nova-compute[73144]:     <apic/>
Aug 14 22:05:29 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:05:29 user nova-compute[73144]:   </features>
Aug 14 22:05:29 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:05:29 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:05:29 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:05:29 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:05:29 user nova-compute[73144]:   </clock>
Aug 14 22:05:29 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:05:29 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:05:29 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:05:29 user nova-compute[73144]:   </cpu>
Aug 14 22:05:29 user nova-compute[73144]:   <devices>
Aug 14 22:05:29 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:05:29 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:05:29 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk"/>
Aug 14 22:05:29 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:05:29 user nova-compute[73144]:     </disk>
Aug 14 22:05:29 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:05:29 user nova-compute[73144]:       <mac address="fa:16:3e:c2:57:f9"/>
Aug 14 22:05:29 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:05:29 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:05:29 user nova-compute[73144]:       <target dev="tap86eba6fd-e5"/>
Aug 14 22:05:29 user nova-compute[73144]:     </interface>
Aug 14 22:05:29 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:05:29 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/console.log" append="off"/>
Aug 14 22:05:29 user nova-compute[73144]:     </serial>
Aug 14 22:05:29 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:05:29 user nova-compute[73144]:     <video>
Aug 14 22:05:29 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:05:29 user nova-compute[73144]:     </video>
Aug 14 22:05:29 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:05:29 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:05:29 user nova-compute[73144]:     </rng>
Aug 14 22:05:29 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:05:29 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:05:29 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:05:29 user nova-compute[73144]:     </memballoon>
Aug 14 22:05:29 user nova-compute[73144]:   </devices>
Aug 14 22:05:29 user nova-compute[73144]: </domain>
Aug 14 22:05:29 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-69473342',display_name='tempest-ServersNegativeTestJSON-server-69473342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-69473342',id=41,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17398a626e67472e81402db4abe498e1',ramdisk_id='',reservation_id='r-o9pw83o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712834715',owner_user_name='tempest-ServersNegativeTestJSON-1712834715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:05:27Z,user_data=None,user_id='43342fae8732443c990af06487af5c0b',uuid=9e9d6b63-cc96-431f-ab2f-733809ffdcb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converting VIF {"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=86eba6fd-e57e-4530-b80f-d966b2db71af,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eba6fd-e5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG os_vif [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=86eba6fd-e57e-4530-b80f-d966b2db71af,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eba6fd-e5') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86eba6fd-e5, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86eba6fd-e5, col_values=(('external_ids', {'iface-id': '86eba6fd-e57e-4530-b80f-d966b2db71af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:57:f9', 'vm-uuid': '9e9d6b63-cc96-431f-ab2f-733809ffdcb3'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:29 user nova-compute[73144]: INFO os_vif [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=86eba6fd-e57e-4530-b80f-d966b2db71af,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eba6fd-e5')
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] No VIF found with MAC fa:16:3e:c2:57:f9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updated VIF entry in instance network info cache for port 86eba6fd-e57e-4530-b80f-d966b2db71af. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updating instance_info_cache with network_info: [{"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d09b1702-ed08-4a19-873d-16c16404e355 req-eb197950-25f7-4d4b-a8ea-cbe70add640d service nova] Releasing lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "793724d3-abe5-41ad-9711-4f31d009dea1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "793724d3-abe5-41ad-9711-4f31d009dea1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:30 user nova-compute[73144]: INFO nova.compute.manager [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Terminating instance
Aug 14 22:05:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Instance destroyed successfully.
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.objects.instance [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'resources' on Instance uuid 793724d3-abe5-41ad-9711-4f31d009dea1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1174461383',display_name='tempest-TestVolumeBootPattern-server-1174461383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1174461383',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:04:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-4ijyi2cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:04:01Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=793724d3-abe5-41ad-9711-4f31d009dea1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "address": "fa:16:3e:cd:86:47", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a600806-5a", "ovs_interfaceid": "3a600806-5a60-48f7-b26e-a3ddb89487e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:86:47,bridge_name='br-int',has_traffic_filtering=True,id=3a600806-5a60-48f7-b26e-a3ddb89487e1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a600806-5a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_vif [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:86:47,bridge_name='br-int',has_traffic_filtering=True,id=3a600806-5a60-48f7-b26e-a3ddb89487e1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a600806-5a') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a600806-5a, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:31 user nova-compute[73144]: INFO os_vif [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:86:47,bridge_name='br-int',has_traffic_filtering=True,id=3a600806-5a60-48f7-b26e-a3ddb89487e1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a600806-5a')
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAaqPoeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:05:31 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a5aa2-dc7b-41c4-9b9c-85c828584c9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4819b-ea32-462c-ab9c-98364574f117]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:31 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:31 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:31 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:05:31 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:05:31 user nova-compute[73144]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef (non-flash)
Aug 14 22:05:31 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586c3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef'): ({'sdh'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Removing single pathed devices sdh {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[555df31b-8300-4b09-a65e-584fbfecb661]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-4f38c163-49c7-4b03-a2e9-1a5ad0265bb9 req-1154cbc5-242a-45af-9e90-a27437719cf2 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received event network-vif-unplugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4f38c163-49c7-4b03-a2e9-1a5ad0265bb9 req-1154cbc5-242a-45af-9e90-a27437719cf2 service nova] Acquiring lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4f38c163-49c7-4b03-a2e9-1a5ad0265bb9 req-1154cbc5-242a-45af-9e90-a27437719cf2 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4f38c163-49c7-4b03-a2e9-1a5ad0265bb9 req-1154cbc5-242a-45af-9e90-a27437719cf2 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-4f38c163-49c7-4b03-a2e9-1a5ad0265bb9 req-1154cbc5-242a-45af-9e90-a27437719cf2 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] No waiting events found dispatching network-vif-unplugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-4f38c163-49c7-4b03-a2e9-1a5ad0265bb9 req-1154cbc5-242a-45af-9e90-a27437719cf2 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received event network-vif-unplugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c680b0e5-df84-4ec3-8478-18640ed21c9c]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flushing IO for device /dev/sdh {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1d0897-540c-485a-936f-7e376b7cf464]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e8d97d-d3c9-4185-8e67-7c16cd05b7bd]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] SCSI volumes sdh have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0333bd07-286a-4244-8dca-fb5dffcd03a2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcacd5d-aad6-43df-b1c1-5266cb373fc7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260]
Aug 14 22:05:31 user nova-compute[73144]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef, portal: 172.16.0.220,3260] successful.
Aug 14 22:05:31 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c1aabd-94c4-4b21-9b44-3b11dd28d024]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== disconnect_volume: return (296ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:05:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Deleting instance files /opt/stack/data/nova/instances/793724d3-abe5-41ad-9711-4f31d009dea1_del
Aug 14 22:05:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Deletion of /opt/stack/data/nova/instances/793724d3-abe5-41ad-9711-4f31d009dea1_del complete
Aug 14 22:05:31 user nova-compute[73144]: INFO nova.compute.manager [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 14 22:05:31 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:05:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:32 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:32 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Took 0.83 seconds to deallocate network for instance.
Aug 14 22:05:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-fe3b8297-7890-409a-b5f1-050708c165b8 req-09ef2d6f-4a04-4804-88f4-11c58f6c6d44 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received event network-vif-deleted-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050733.0727637, 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] VM Resumed (Lifecycle Event)
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Instance spawned successfully.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050733.0738766, 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] VM Started (Lifecycle Event)
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.compute.manager [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Took 0.75 seconds to detach 1 volumes for instance.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Deleting volume: ca0e16c3-04d3-4a1c-a651-1ebcfcc0c0ef {{(pid=73144) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.compute.manager [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Took 6.51 seconds to build instance.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad2db7ab-c829-4976-85ca-3b77ddc854d8 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.603s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received event network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Acquiring lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Lock "793724d3-abe5-41ad-9711-4f31d009dea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] No waiting events found dispatching network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:33 user nova-compute[73144]: WARNING nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Received unexpected event network-vif-plugged-3a600806-5a60-48f7-b26e-a3ddb89487e1 for instance with vm_state deleted and task_state None.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received event network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] No waiting events found dispatching network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:33 user nova-compute[73144]: WARNING nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received unexpected event network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af for instance with vm_state active and task_state None.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received event network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] No waiting events found dispatching network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:33 user nova-compute[73144]: WARNING nova.compute.manager [req-e28b20fd-fea5-4346-bb80-a9dcaac2b016 req-93d506ad-f05c-40c6-a2ce-a635ca958401 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received unexpected event network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af for instance with vm_state active and task_state None.
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:33 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Deleted allocations for instance 793724d3-abe5-41ad-9711-4f31d009dea1
Aug 14 22:05:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-61da9a60-cba7-4bdc-83b6-dda122279c88 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "793724d3-abe5-41ad-9711-4f31d009dea1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.749s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:34 user nova-compute[73144]: INFO nova.compute.manager [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Terminating instance
Aug 14 22:05:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1345b46-50dc-47e1-89e2-cc17b1c53b6c req-99bb374c-6883-49be-9174-a5a0f44f7577 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-unplugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f1345b46-50dc-47e1-89e2-cc17b1c53b6c req-99bb374c-6883-49be-9174-a5a0f44f7577 service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f1345b46-50dc-47e1-89e2-cc17b1c53b6c req-99bb374c-6883-49be-9174-a5a0f44f7577 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f1345b46-50dc-47e1-89e2-cc17b1c53b6c req-99bb374c-6883-49be-9174-a5a0f44f7577 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1345b46-50dc-47e1-89e2-cc17b1c53b6c req-99bb374c-6883-49be-9174-a5a0f44f7577 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-unplugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-f1345b46-50dc-47e1-89e2-cc17b1c53b6c req-99bb374c-6883-49be-9174-a5a0f44f7577 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-unplugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:05:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Instance destroyed successfully.
Aug 14 22:05:35 user nova-compute[73144]: DEBUG nova.objects.instance [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'resources' on Instance uuid cbc94659-f76f-4b53-903b-60f59b0dfc55 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872334805',display_name='tempest-TestMinimumBasicScenario-server-1872334805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872334805',id=35,image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1HtMIZDB5L2KiUNfOZ1iQNQmfkn3XwTU3u05v5z3hwMkd5vEOICMxCq0xcnImKICtaZ9ksOizbJ9rvRBHmEIzz+elqoLnyXq7QW2fSP+wbW77K6e23dr7hFN1osHAQUQ==',key_name='tempest-TestMinimumBasicScenario-24525501',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-wwyngt8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='943601c3-7bf1-4cb6-86ae-bc63be3769d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:02:52Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cbc94659-f76f-4b53-903b-60f59b0dfc55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "address": "fa:16:3e:81:41:b2", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11dc58f-a4", "ovs_interfaceid": "e11dc58f-a416-43a7-b0b9-73ee1dd7382d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG os_vif [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape11dc58f-a4, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:35 user nova-compute[73144]: INFO os_vif [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=e11dc58f-a416-43a7-b0b9-73ee1dd7382d,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11dc58f-a4')
Aug 14 22:05:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Deleting instance files /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55_del
Aug 14 22:05:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Deletion of /opt/stack/data/nova/instances/cbc94659-f76f-4b53-903b-60f59b0dfc55_del complete
Aug 14 22:05:35 user nova-compute[73144]: INFO nova.compute.manager [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 22:05:35 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:05:35 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Took 0.53 seconds to deallocate network for instance.
Aug 14 22:05:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:36 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:05:36 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:05:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:36 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Deleted allocations for instance cbc94659-f76f-4b53-903b-60f59b0dfc55
Aug 14 22:05:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-24540d20-102f-41de-812c-b757a107d276 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.080s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-693f5977-9c8c-4524-8816-fd138ceda5d4 req-737cccb2-460b-4f9b-96e3-dacb7ebff1a7 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-693f5977-9c8c-4524-8816-fd138ceda5d4 req-737cccb2-460b-4f9b-96e3-dacb7ebff1a7 service nova] Acquiring lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:05:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-693f5977-9c8c-4524-8816-fd138ceda5d4 req-737cccb2-460b-4f9b-96e3-dacb7ebff1a7 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:05:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-693f5977-9c8c-4524-8816-fd138ceda5d4 req-737cccb2-460b-4f9b-96e3-dacb7ebff1a7 service nova] Lock "cbc94659-f76f-4b53-903b-60f59b0dfc55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:05:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-693f5977-9c8c-4524-8816-fd138ceda5d4 req-737cccb2-460b-4f9b-96e3-dacb7ebff1a7 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] No waiting events found dispatching network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:05:37 user nova-compute[73144]: WARNING nova.compute.manager [req-693f5977-9c8c-4524-8816-fd138ceda5d4 req-737cccb2-460b-4f9b-96e3-dacb7ebff1a7 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received unexpected event network-vif-plugged-e11dc58f-a416-43a7-b0b9-73ee1dd7382d for instance with vm_state deleted and task_state None.
Aug 14 22:05:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-693f5977-9c8c-4524-8816-fd138ceda5d4 req-737cccb2-460b-4f9b-96e3-dacb7ebff1a7 service nova] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Received event network-vif-deleted-e11dc58f-a416-43a7-b0b9-73ee1dd7382d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:05:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:46 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050731.2564504, 793724d3-abe5-41ad-9711-4f31d009dea1 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:05:46 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] VM Stopped (Lifecycle Event)
Aug 14 22:05:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ca2cccc8-cb39-45d4-9fdd-1be5ce58cbc0 None None] [instance: 793724d3-abe5-41ad-9711-4f31d009dea1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:50 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050735.2181633, cbc94659-f76f-4b53-903b-60f59b0dfc55 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:05:50 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] VM Stopped (Lifecycle Event)
Aug 14 22:05:50 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ecc2af5a-0e77-49a1-9de5-6985a80af145 None None] [instance: cbc94659-f76f-4b53-903b-60f59b0dfc55] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:05:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:05:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:01 user nova-compute[73144]: INFO nova.compute.manager [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Terminating instance
Aug 14 22:06:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-75abcb44-42c0-4e55-a92a-8ac9f758b80a req-6976ddb9-01ec-45f5-9224-fb8fca329751 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-75abcb44-42c0-4e55-a92a-8ac9f758b80a req-6976ddb9-01ec-45f5-9224-fb8fca329751 service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-75abcb44-42c0-4e55-a92a-8ac9f758b80a req-6976ddb9-01ec-45f5-9224-fb8fca329751 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-75abcb44-42c0-4e55-a92a-8ac9f758b80a req-6976ddb9-01ec-45f5-9224-fb8fca329751 service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-75abcb44-42c0-4e55-a92a-8ac9f758b80a req-6976ddb9-01ec-45f5-9224-fb8fca329751 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-75abcb44-42c0-4e55-a92a-8ac9f758b80a req-6976ddb9-01ec-45f5-9224-fb8fca329751 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-unplugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:06:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:02 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Instance destroyed successfully.
Aug 14 22:06:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'resources' on Instance uuid f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944081948',display_name='tempest-ServerRescueNegativeTestJSON-server-944081948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944081948',id=33,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTxvFBpA115FRLzrCvh9O4wn7LkFvcpc5chtex4LDkdpOfKw8PHe6LbUNmXc+k8oMdCHMqCUtthA30tOtsLMkNZ5VBAgvGuhT2XkWx67lJ2Jx0LDdk8nGIkJwQjdgh+Rg==',key_name='tempest-keypair-417536897',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:01:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ju0iijj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "address": "fa:16:3e:e0:d1:46", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb484bc7b-fb", "ovs_interfaceid": "b484bc7b-fb19-4a51-ab9b-aafb744e31ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG os_vif [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb484bc7b-fb, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:06:02 user nova-compute[73144]: INFO os_vif [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d1:46,bridge_name='br-int',has_traffic_filtering=True,id=b484bc7b-fb19-4a51-ab9b-aafb744e31ff,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb484bc7b-fb')
Aug 14 22:06:02 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Deleting instance files /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66_del
Aug 14 22:06:02 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Deletion of /opt/stack/data/nova/instances/f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66_del complete
Aug 14 22:06:02 user nova-compute[73144]: INFO nova.compute.manager [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 22:06:02 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:06:02 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:03 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Took 0.96 seconds to deallocate network for instance.
Aug 14 22:06:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-1431ae84-a198-4814-8175-7c448bc19d08 req-47d79b30-a8e2-4612-80ac-d61b208b2e21 service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-deleted-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:03 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Deleted allocations for instance f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66
Aug 14 22:06:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57e33b83-0da2-4f63-82e1-4e0c2ebff5a6 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-b788ec3b-dac5-4418-a2b8-88912f6e0f1c req-9463cf5b-d8c3-45e0-ad7b-5526e5df2dfa service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b788ec3b-dac5-4418-a2b8-88912f6e0f1c req-9463cf5b-d8c3-45e0-ad7b-5526e5df2dfa service nova] Acquiring lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b788ec3b-dac5-4418-a2b8-88912f6e0f1c req-9463cf5b-d8c3-45e0-ad7b-5526e5df2dfa service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b788ec3b-dac5-4418-a2b8-88912f6e0f1c req-9463cf5b-d8c3-45e0-ad7b-5526e5df2dfa service nova] Lock "f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-b788ec3b-dac5-4418-a2b8-88912f6e0f1c req-9463cf5b-d8c3-45e0-ad7b-5526e5df2dfa service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] No waiting events found dispatching network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:03 user nova-compute[73144]: WARNING nova.compute.manager [req-b788ec3b-dac5-4418-a2b8-88912f6e0f1c req-9463cf5b-d8c3-45e0-ad7b-5526e5df2dfa service nova] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Received unexpected event network-vif-plugged-b484bc7b-fb19-4a51-ab9b-aafb744e31ff for instance with vm_state deleted and task_state None.
Aug 14 22:06:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:12 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:15 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:06:15 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=24.836326599121094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance ef7cd461-517e-458c-a22a-d226daf54347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c0cb840-2ddf-4a02-9a74-92339044bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 22:06:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 22:06:16 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:06:16 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:06:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:06:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:16 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:16 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 22:06:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG nova.objects.instance [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050762.2358282, f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:06:17 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] VM Stopped (Lifecycle Event)
Aug 14 22:06:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4b76cac4-2155-4acc-8168-ebb8c287849a None None] [instance: f49073bb-4a7f-4b34-a5f8-b2fe9bff6a66] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:17 user nova-compute[73144]: INFO nova.compute.manager [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attaching volume 7b548336-31f8-4f28-984d-e024e3071ef8 to /dev/vdb
Aug 14 22:06:17 user nova-compute[73144]: DEBUG os_brick.utils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad10e9-efc6-40f6-8185-37f3e32aad6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82acaa7-f1c0-4be8-9c8e-8429a51ecdbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[59648117-47af-4c07-bd68-f80b77759d77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[968e2a74-d2a2-4950-810a-9ac2d0140148]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:06:17 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:06:17 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12965b-948e-446f-ad84-4dff526002c1]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG os_brick.utils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:06:17 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating existing volume attachment record: 49e33214-6f05-4210-a17f-9446f884ee75 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [{"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-9a143491-b86c-4768-9014-306bbeee8ad9" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 22:06:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 22:06:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:23 user nova-compute[73144]: INFO nova.compute.manager [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Unrescuing
Aug 14 22:06:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:06:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquired lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:06:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:06:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Updating instance_info_cache with network_info: [{"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Releasing lock "refresh_cache-4c0cb840-2ddf-4a02-9a74-92339044bed4" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:06:23 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'flavor' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-89b609a2-cd01-4fa2-bbcd-0b169ecedc2f req-37a7b0a8-dea0-48ae-b22d-2ccdfcd1cfe7 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-89b609a2-cd01-4fa2-bbcd-0b169ecedc2f req-37a7b0a8-dea0-48ae-b22d-2ccdfcd1cfe7 service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-89b609a2-cd01-4fa2-bbcd-0b169ecedc2f req-37a7b0a8-dea0-48ae-b22d-2ccdfcd1cfe7 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-89b609a2-cd01-4fa2-bbcd-0b169ecedc2f req-37a7b0a8-dea0-48ae-b22d-2ccdfcd1cfe7 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-89b609a2-cd01-4fa2-bbcd-0b169ecedc2f req-37a7b0a8-dea0-48ae-b22d-2ccdfcd1cfe7 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:24 user nova-compute[73144]: WARNING nova.compute.manager [req-89b609a2-cd01-4fa2-bbcd-0b169ecedc2f req-37a7b0a8-dea0-48ae-b22d-2ccdfcd1cfe7 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:06:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance destroyed successfully.
Aug 14 22:06:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-3898c433-cddf-45a1-a8c6-dbd4fcb8c76e req-c698c067-e44d-41b3-8aaf-d0d9eec0d50c service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3898c433-cddf-45a1-a8c6-dbd4fcb8c76e req-c698c067-e44d-41b3-8aaf-d0d9eec0d50c service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3898c433-cddf-45a1-a8c6-dbd4fcb8c76e req-c698c067-e44d-41b3-8aaf-d0d9eec0d50c service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3898c433-cddf-45a1-a8c6-dbd4fcb8c76e req-c698c067-e44d-41b3-8aaf-d0d9eec0d50c service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-3898c433-cddf-45a1-a8c6-dbd4fcb8c76e req-c698c067-e44d-41b3-8aaf-d0d9eec0d50c service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:26 user nova-compute[73144]: WARNING nova.compute.manager [req-3898c433-cddf-45a1-a8c6-dbd4fcb8c76e req-c698c067-e44d-41b3-8aaf-d0d9eec0d50c service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:06:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJBUgvlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:06:26 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:06:26 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:06:26 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296eea8-b4ad-4bbd-b60a-21c851bde8fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:06:26 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2963dfb2-218f-47b2-b3f5-867ebda4d14b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8] added
Aug 14 22:06:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c0c18c-e74b-4dbf-8904-46251ac0cec6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d74d74-8ba3-4927-ace4-5a9e68abc9e2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJBUgvlu {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJBUgvlu" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d3db7-7397-40da-a1e0-2b5c5862b799]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJBUgvlu'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[943616e8-db71-4cd1-97fa-8241e3b2dbea]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b8aa0-741d-4e11-8691-693984dcb323]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a8ee95-cb33-4468-abb6-bf5bfedc4317]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260]
Aug 14 22:06:26 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260] successful.
Aug 14 22:06:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3e5ebb-deed-473a-9bbd-0d7e88d9610b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a8d7c-901d-4099-a002-f7ba1628f305]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 (non-flash)
Aug 14 22:06:26 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[437ca434-0e2f-4270-8e2a-07baeb743412]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJBUgvlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:06:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:06:27 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23565373430623837', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:06:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565373430623837', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:06:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:06:27 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:06:27 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:06:27 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:06:27 user nova-compute[73144]:   <serial>7b548336-31f8-4f28-984d-e024e3071ef8</serial>
Aug 14 22:06:27 user nova-compute[73144]: </disk>
Aug 14 22:06:27 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:28 user nova-compute[73144]: WARNING nova.compute.manager [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:28 user nova-compute[73144]: WARNING nova.compute.manager [req-d50f079f-8aa8-45c9-b393-e520b9b939b3 req-419517cb-bd7f-4ba0-acc2-5861e3fb415a service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state rescued and task_state unrescuing.
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No VIF found with MAC fa:16:3e:98:44:55, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for 4c0cb840-2ddf-4a02-9a74-92339044bed4 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050788.2417493, 4c0cb840-2ddf-4a02-9a74-92339044bed4 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:06:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] VM Resumed (Lifecycle Event)
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1f2c3170-3c3b-4dee-b88e-f2f09ce1701b tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:06:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050788.254472, 4c0cb840-2ddf-4a02-9a74-92339044bed4 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:06:28 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] VM Started (Lifecycle Event)
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-571dd8d1-d667-4b35-87be-2e65763d624a tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.067s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:28 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:06:28 user nova-compute[73144]: INFO nova.compute.claims [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Claim successful on node user
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:06:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.policy [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5b646bc914e419e987ebada26905446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1319de1ca444198f3edddf26ce07b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:06:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Creating image(s)
Aug 14 22:06:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "/opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "/opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "b5beb6fde0cc167225f4c9608a4b22dae862b25e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "b5beb6fde0cc167225f4c9608a4b22dae862b25e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.part --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.part --force-share --output=json" returned: 0 in 0.212s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.virt.images [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] 77d76055-e83c-4233-8c59-ade63177ab2d was qcow2, converting to raw {{(pid=73144) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.privsep.utils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73144) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.part /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.converted {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Successfully created port: 138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.part /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.converted" returned: 0 in 0.269s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.converted --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "b5beb6fde0cc167225f4c9608a4b22dae862b25e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.112s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:30 user nova-compute[73144]: INFO nova.compute.manager [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Detaching volume 7b548336-31f8-4f28-984d-e024e3071ef8
Aug 14 22:06:30 user nova-compute[73144]: INFO nova.virt.block_device [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attempting to driver detach volume 7b548336-31f8-4f28-984d-e024e3071ef8 from mountpoint /dev/vdb
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "b5beb6fde0cc167225f4c9608a4b22dae862b25e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "b5beb6fde0cc167225f4c9608a4b22dae862b25e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Attempting to detach device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:06:30 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:06:30 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:06:30 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:06:30 user nova-compute[73144]:   <serial>7b548336-31f8-4f28-984d-e024e3071ef8</serial>
Aug 14 22:06:30 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:06:30 user nova-compute[73144]: </disk>
Aug 14 22:06:30 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:06:30 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config.
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:06:30 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:06:30 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:06:30 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:06:30 user nova-compute[73144]:   <serial>7b548336-31f8-4f28-984d-e024e3071ef8</serial>
Aug 14 22:06:30 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:06:30 user nova-compute[73144]: </disk>
Aug 14 22:06:30 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Successfully updated port: 138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquired lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:06:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing instance network info cache due to event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] Acquiring lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e,backing_fmt=raw /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e,backing_fmt=raw /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk 1073741824" returned: 0 in 0.047s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "b5beb6fde0cc167225f4c9608a4b22dae862b25e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050791.3574858, e5f03cb8-f350-4e69-af26-1a40519be4da => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:06:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config.
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJBUgvlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:06:31 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b5104f-ea92-46f9-81b7-c62b4d2a7ebe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.neutron [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[56262fab-774f-43e4-8032-21b0e674532f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:31 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:31 user nova-compute[73144]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 (non-flash)
Aug 14 22:06:31 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:31 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:31 user nova-compute[73144]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 (non-flash)
Aug 14 22:06:31 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa15868b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Cannot resize image /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'migration_context' on Instance uuid cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Releasing lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance network_info: |[{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] Acquired lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.neutron [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Ensure instance console log exists: /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Start _get_guest_xml network_info=[{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:06:26Z,direct_url=<?>,disk_format='qcow2',id=77d76055-e83c-4233-8c59-ade63177ab2d,min_disk=0,min_ram=0,name='tempest-scenario-img--306317964',owner='6d1319de1ca444198f3edddf26ce07b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:06:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '77d76055-e83c-4233-8c59-ade63177ab2d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107eb69-4dcc-41e9-bed8-f54d702e0ab1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:06:31 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:06:26Z,direct_url=<?>,disk_format='qcow2',id=77d76055-e83c-4233-8c59-ade63177ab2d,min_disk=0,min_ram=0,name='tempest-scenario-img--306317964',owner='6d1319de1ca444198f3edddf26ce07b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:06:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1859676118',display_name='tempest-TestMinimumBasicScenario-server-1859676118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1859676118',id=42,image_ref='77d76055-e83c-4233-8c59-ade63177ab2d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh/2uF8toKdrRU4M9Er/ZYScuuazfUOKfRdZkjXybwCrVmP3q2yFjyvRm1PQXwxDM3V/hF2KzQxk6M+8Os/QFdmRM0bxdRDa3hvEnEDXLZkJ1Lvx27DKr6b9QXR244DHQ==',key_name='tempest-TestMinimumBasicScenario-1262022519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-xx4cd4c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77d76055-e83c-4233-8c59-ade63177ab2d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:06:29Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cdec4545-a332-4ea3-ba7e-0af93fac0ff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e1:a1,bridge_name='br-int',has_traffic_filtering=True,id=138a9dbe-1881-4f2b-8df1-ecf97565f90c,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a9dbe-18') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'pci_devices' on Instance uuid cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[27391e94-9b53-42fb-8329-b5b83293efc1]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:06:31 user nova-compute[73144]:   <uuid>cdec4545-a332-4ea3-ba7e-0af93fac0ff3</uuid>
Aug 14 22:06:31 user nova-compute[73144]:   <name>instance-0000002a</name>
Aug 14 22:06:31 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:06:31 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:06:31 user nova-compute[73144]:   <metadata>
Aug 14 22:06:31 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:06:31 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:06:31 user nova-compute[73144]:       <nova:name>tempest-TestMinimumBasicScenario-server-1859676118</nova:name>
Aug 14 22:06:31 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:06:31</nova:creationTime>
Aug 14 22:06:31 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:06:31 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:06:31 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:06:31 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:06:31 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:06:31 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:06:31 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:06:31 user nova-compute[73144]:       <nova:owner>
Aug 14 22:06:31 user nova-compute[73144]:         <nova:user uuid="f5b646bc914e419e987ebada26905446">tempest-TestMinimumBasicScenario-1966855885-project-member</nova:user>
Aug 14 22:06:31 user nova-compute[73144]:         <nova:project uuid="6d1319de1ca444198f3edddf26ce07b1">tempest-TestMinimumBasicScenario-1966855885</nova:project>
Aug 14 22:06:31 user nova-compute[73144]:       </nova:owner>
Aug 14 22:06:31 user nova-compute[73144]:       <nova:root type="image" uuid="77d76055-e83c-4233-8c59-ade63177ab2d"/>
Aug 14 22:06:31 user nova-compute[73144]:       <nova:ports>
Aug 14 22:06:31 user nova-compute[73144]:         <nova:port uuid="138a9dbe-1881-4f2b-8df1-ecf97565f90c">
Aug 14 22:06:31 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 22:06:31 user nova-compute[73144]:         </nova:port>
Aug 14 22:06:31 user nova-compute[73144]:       </nova:ports>
Aug 14 22:06:31 user nova-compute[73144]:     </nova:instance>
Aug 14 22:06:31 user nova-compute[73144]:   </metadata>
Aug 14 22:06:31 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:06:31 user nova-compute[73144]:     <system>
Aug 14 22:06:31 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:06:31 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:06:31 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:06:31 user nova-compute[73144]:       <entry name="serial">cdec4545-a332-4ea3-ba7e-0af93fac0ff3</entry>
Aug 14 22:06:31 user nova-compute[73144]:       <entry name="uuid">cdec4545-a332-4ea3-ba7e-0af93fac0ff3</entry>
Aug 14 22:06:31 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:06:31 user nova-compute[73144]:     </system>
Aug 14 22:06:31 user nova-compute[73144]:   </sysinfo>
Aug 14 22:06:31 user nova-compute[73144]:   <os>
Aug 14 22:06:31 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:06:31 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:06:31 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:06:31 user nova-compute[73144]:   </os>
Aug 14 22:06:31 user nova-compute[73144]:   <features>
Aug 14 22:06:31 user nova-compute[73144]:     <acpi/>
Aug 14 22:06:31 user nova-compute[73144]:     <apic/>
Aug 14 22:06:31 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:06:31 user nova-compute[73144]:   </features>
Aug 14 22:06:31 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:06:31 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:06:31 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:06:31 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:06:31 user nova-compute[73144]:   </clock>
Aug 14 22:06:31 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:06:31 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:06:31 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:06:31 user nova-compute[73144]:   </cpu>
Aug 14 22:06:31 user nova-compute[73144]:   <devices>
Aug 14 22:06:31 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:06:31 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:06:31 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk"/>
Aug 14 22:06:31 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:06:31 user nova-compute[73144]:     </disk>
Aug 14 22:06:31 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:06:31 user nova-compute[73144]:       <mac address="fa:16:3e:e2:e1:a1"/>
Aug 14 22:06:31 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:06:31 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:06:31 user nova-compute[73144]:       <target dev="tap138a9dbe-18"/>
Aug 14 22:06:31 user nova-compute[73144]:     </interface>
Aug 14 22:06:31 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:06:31 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/console.log" append="off"/>
Aug 14 22:06:31 user nova-compute[73144]:     </serial>
Aug 14 22:06:31 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:06:31 user nova-compute[73144]:     <video>
Aug 14 22:06:31 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:06:31 user nova-compute[73144]:     </video>
Aug 14 22:06:31 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:06:31 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:06:31 user nova-compute[73144]:     </rng>
Aug 14 22:06:31 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:06:31 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:06:31 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:06:31 user nova-compute[73144]:     </memballoon>
Aug 14 22:06:31 user nova-compute[73144]:   </devices>
Aug 14 22:06:31 user nova-compute[73144]: </domain>
Aug 14 22:06:31 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1859676118',display_name='tempest-TestMinimumBasicScenario-server-1859676118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1859676118',id=42,image_ref='77d76055-e83c-4233-8c59-ade63177ab2d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh/2uF8toKdrRU4M9Er/ZYScuuazfUOKfRdZkjXybwCrVmP3q2yFjyvRm1PQXwxDM3V/hF2KzQxk6M+8Os/QFdmRM0bxdRDa3hvEnEDXLZkJ1Lvx27DKr6b9QXR244DHQ==',key_name='tempest-TestMinimumBasicScenario-1262022519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-xx4cd4c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77d76055-e83c-4233-8c59-ade63177ab2d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:06:29Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cdec4545-a332-4ea3-ba7e-0af93fac0ff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e1:a1,bridge_name='br-int',has_traffic_filtering=True,id=138a9dbe-1881-4f2b-8df1-ecf97565f90c,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a9dbe-18') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_vif [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e1:a1,bridge_name='br-int',has_traffic_filtering=True,id=138a9dbe-1881-4f2b-8df1-ecf97565f90c,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a9dbe-18') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap138a9dbe-18, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap138a9dbe-18, col_values=(('external_ids', {'iface-id': '138a9dbe-1881-4f2b-8df1-ecf97565f90c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:e1:a1', 'vm-uuid': 'cdec4545-a332-4ea3-ba7e-0af93fac0ff3'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5b8eb3-eb3f-43ee-8f0b-d33c06e3648b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:31 user nova-compute[73144]: INFO os_vif [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e1:a1,bridge_name='br-int',has_traffic_filtering=True,id=138a9dbe-1881-4f2b-8df1-ecf97565f90c,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a9dbe-18')
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5855539-5877-4a87-bbca-0fff2a079c29]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No VIF found with MAC fa:16:3e:e2:e1:a1, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a80789-af5e-413d-8e82-649e4421dfe7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3650d3e-2220-4dfa-a1b9-09d84e277bbc]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260]
Aug 14 22:06:31 user nova-compute[73144]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8, portal: 172.16.0.220,3260] successful.
Aug 14 22:06:31 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b548336-31f8-4f28-984d-e024e3071ef8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7831ac07-df64-49f2-9d8c-06fa795c86bb]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== disconnect_volume: return (364ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.neutron [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updated VIF entry in instance network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG nova.network.neutron [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56f62f3b-0e97-4b38-81b9-18bbf8a98dba req-ff1dc9ee-cd44-4a92-b558-d0a98efee1d8 service nova] Releasing lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:06:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:32 user nova-compute[73144]: DEBUG nova.objects.instance [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-df341183-4855-40a0-b863-372398bfc9c6 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.062s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-2f4f535a-ac78-429e-998d-a81da54558c7 req-55bf8194-a9e9-4dc2-9e30-8e3d3f8030f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2f4f535a-ac78-429e-998d-a81da54558c7 req-55bf8194-a9e9-4dc2-9e30-8e3d3f8030f5 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2f4f535a-ac78-429e-998d-a81da54558c7 req-55bf8194-a9e9-4dc2-9e30-8e3d3f8030f5 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2f4f535a-ac78-429e-998d-a81da54558c7 req-55bf8194-a9e9-4dc2-9e30-8e3d3f8030f5 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-2f4f535a-ac78-429e-998d-a81da54558c7 req-55bf8194-a9e9-4dc2-9e30-8e3d3f8030f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:33 user nova-compute[73144]: WARNING nova.compute.manager [req-2f4f535a-ac78-429e-998d-a81da54558c7 req-55bf8194-a9e9-4dc2-9e30-8e3d3f8030f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received unexpected event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with vm_state building and task_state spawning.
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050795.3785334, cdec4545-a332-4ea3-ba7e-0af93fac0ff3 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:06:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] VM Resumed (Lifecycle Event)
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:06:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance spawned successfully.
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050795.3796816, cdec4545-a332-4ea3-ba7e-0af93fac0ff3 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:06:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] VM Started (Lifecycle Event)
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:06:35 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a5d2cdc-4de3-46da-8cca-0ef33c67f4ef req-85a9fa7e-a99f-45ef-a565-0d92edec5625 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a5d2cdc-4de3-46da-8cca-0ef33c67f4ef req-85a9fa7e-a99f-45ef-a565-0d92edec5625 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a5d2cdc-4de3-46da-8cca-0ef33c67f4ef req-85a9fa7e-a99f-45ef-a565-0d92edec5625 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4a5d2cdc-4de3-46da-8cca-0ef33c67f4ef req-85a9fa7e-a99f-45ef-a565-0d92edec5625 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-4a5d2cdc-4de3-46da-8cca-0ef33c67f4ef req-85a9fa7e-a99f-45ef-a565-0d92edec5625 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:35 user nova-compute[73144]: WARNING nova.compute.manager [req-4a5d2cdc-4de3-46da-8cca-0ef33c67f4ef req-85a9fa7e-a99f-45ef-a565-0d92edec5625 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received unexpected event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with vm_state building and task_state spawning.
Aug 14 22:06:35 user nova-compute[73144]: INFO nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 14 22:06:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:35 user nova-compute[73144]: INFO nova.compute.manager [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Took 6.83 seconds to build instance.
Aug 14 22:06:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b94cb9ba-7d7b-4f38-9bca-d432d7e97378 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.928s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:06:44 user nova-compute[73144]: INFO nova.compute.claims [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Claim successful on node user
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.network.neutron [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:06:44 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.policy [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a3e93f724b43a08ee42b79c63ed4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f796a65843b467a9889f47789c87eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:06:44 user nova-compute[73144]: INFO nova.virt.block_device [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Booting with volume 08419ad9-939f-4eb5-bd2f-959f3d5b6236 at /dev/vda
Aug 14 22:06:44 user nova-compute[73144]: DEBUG os_brick.utils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd480b56-e1f9-4029-af65-8c11362496a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a557b0-fd1f-4816-9cd6-f2b7f3af778c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da71596-73cc-4d44-aefa-8a70d9756ba3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96b98b-d276-4e47-aace-3891949a6cc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:06:44 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:06:44 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a93cb89-edfd-43c7-a667-05117ecfd81d]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG os_brick.utils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:06:44 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Updating existing volume attachment record: d19c6c63-e4c7-482c-9428-437468f84bd5 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:06:45 user nova-compute[73144]: DEBUG nova.network.neutron [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Successfully created port: 8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Successfully updated port: 8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-changed-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Refreshing instance network info cache due to event network-changed-8845dd0a-60ec-47c8-ab1a-70b7efd35560. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] Acquiring lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] Acquired lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.network.neutron [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Refreshing network info cache for port 8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.network.neutron [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.network.neutron [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8bc847ad-73e2-4612-9908-e28b51144b01 req-6386e332-e5ea-4361-a15a-96557a95a651 service nova] Releasing lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquired lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Updating instance_info_cache with network_info: [{"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Releasing lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Instance network_info: |[{"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:06:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:51 user nova-compute[73144]: INFO nova.compute.manager [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Terminating instance
Aug 14 22:06:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-6a84c7fa-a589-415b-b2f4-7dfab2a81d0a req-2dccac05-84c7-4283-b8df-ea84ed3ee330 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-unplugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6a84c7fa-a589-415b-b2f4-7dfab2a81d0a req-2dccac05-84c7-4283-b8df-ea84ed3ee330 service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6a84c7fa-a589-415b-b2f4-7dfab2a81d0a req-2dccac05-84c7-4283-b8df-ea84ed3ee330 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6a84c7fa-a589-415b-b2f4-7dfab2a81d0a req-2dccac05-84c7-4283-b8df-ea84ed3ee330 service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-6a84c7fa-a589-415b-b2f4-7dfab2a81d0a req-2dccac05-84c7-4283-b8df-ea84ed3ee330 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-unplugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.compute.manager [req-6a84c7fa-a589-415b-b2f4-7dfab2a81d0a req-2dccac05-84c7-4283-b8df-ea84ed3ee330 service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-unplugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:06:52 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Instance destroyed successfully.
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.objects.instance [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lazy-loading 'resources' on Instance uuid 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1260519476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1260519476',id=37,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg7+k97E4gOQGel8zFCAbRELmwjE2sZmKI52g4QtePhhLqymHK+/rKp/SVEfGvKmxiCl72q05G2EPOcEcHwc7qSEdErzlJSc+olT6uzcGGXX9CDqKKXbG3iQDalKb6jeQ==',key_name='tempest-keypair-1868290249',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:05:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69745a6a4d3345fcb143da4f825a2100',ramdisk_id='',reservation_id='r-r0cqfhri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1156240232',owner_user_name='tempest-AttachVolumeShelveTestJSON-1156240232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11172444b2d54c0dae51f822168f586a',uuid=8098d577-b7b2-4881-aa10-5cca7f5ee0f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converting VIF {"id": "cebad443-da70-41b3-aaee-7f539f336c43", "address": "fa:16:3e:32:11:d9", "network": {"id": "4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1263473274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69745a6a4d3345fcb143da4f825a2100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcebad443-da", "ovs_interfaceid": "cebad443-da70-41b3-aaee-7f539f336c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG os_vif [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcebad443-da, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:06:52 user nova-compute[73144]: INFO os_vif [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:11:d9,bridge_name='br-int',has_traffic_filtering=True,id=cebad443-da70-41b3-aaee-7f539f336c43,network=Network(4b67d60c-bbc1-4f2c-bb71-bf65b405c3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcebad443-da')
Aug 14 22:06:52 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Deleting instance files /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1_del
Aug 14 22:06:52 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Deletion of /opt/stack/data/nova/instances/8098d577-b7b2-4881-aa10-5cca7f5ee0f1_del complete
Aug 14 22:06:52 user nova-compute[73144]: INFO nova.compute.manager [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 14 22:06:52 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:06:52 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:53 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Took 0.82 seconds to deallocate network for instance.
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-a54053b4-eaa7-4051-9cc5-7b2626a3ece3 req-b3a8dca5-85d5-4c88-8aeb-c2992555312d service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-deleted-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:53 user nova-compute[73144]: INFO nova.compute.manager [req-a54053b4-eaa7-4051-9cc5-7b2626a3ece3 req-b3a8dca5-85d5-4c88-8aeb-c2992555312d service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Neutron deleted interface cebad443-da70-41b3-aaee-7f539f336c43; detaching it from the instance and deleting it from the info cache
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.network.neutron [req-a54053b4-eaa7-4051-9cc5-7b2626a3ece3 req-b3a8dca5-85d5-4c88-8aeb-c2992555312d service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-a54053b4-eaa7-4051-9cc5-7b2626a3ece3 req-b3a8dca5-85d5-4c88-8aeb-c2992555312d service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Detach interface failed, port_id=cebad443-da70-41b3-aaee-7f539f336c43, reason: Instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:53 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Deleted allocations for instance 8098d577-b7b2-4881-aa10-5cca7f5ee0f1
Aug 14 22:06:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-dcd5fd5c-2776-4cf0-865d-3625b70e3531 tempest-AttachVolumeShelveTestJSON-1156240232 tempest-AttachVolumeShelveTestJSON-1156240232-project-member] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.058s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:06:53 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Creating image(s)
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Ensure instance console log exists: /opt/stack/data/nova/instances/852ffbb8-7a08-425e-b1af-78db45d7313e/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Start _get_guest_xml network_info=[{"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'd19c6c63-e4c7-482c-9428-437468f84bd5', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzGCMOKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '852ffbb8-7a08-425e-b1af-78db45d7313e', 'attached_at': '', 'detached_at': '', 'volume_id': '08419ad9-939f-4eb5-bd2f-959f3d5b6236', 'serial': '08419ad9-939f-4eb5-bd2f-959f3d5b6236'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:06:53 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:06:53 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:06:53 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzGCMOKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:06:54 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:06:54 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:06:54 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcfb720-7597-47af-9e55-7ab6ba1a3495]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:06:54 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfddcce6-a5f1-47a5-9894-289adbf9c050]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236] added
Aug 14 22:06:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673d15d-f18d-4492-b65c-052f7aea3271]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf7109-0fb6-4ea6-b5ba-13d48df76da5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzGCMOKm {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzGCMOKm" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[89588894-bfd5-4331-9fe1-f6e7af21829e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rzGCMOKm'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbc358b-1c72-453d-9487-61460e08c2f7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b242ae7-e7b4-465c-9cf9-1b96bba38102]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-47e24019-97aa-4372-b9d2-e2de2f9a3a26 req-199e9291-0ad8-4515-b435-ac2f91e8a55d service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47e24019-97aa-4372-b9d2-e2de2f9a3a26 req-199e9291-0ad8-4515-b435-ac2f91e8a55d service nova] Acquiring lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47e24019-97aa-4372-b9d2-e2de2f9a3a26 req-199e9291-0ad8-4515-b435-ac2f91e8a55d service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-47e24019-97aa-4372-b9d2-e2de2f9a3a26 req-199e9291-0ad8-4515-b435-ac2f91e8a55d service nova] Lock "8098d577-b7b2-4881-aa10-5cca7f5ee0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG nova.compute.manager [req-47e24019-97aa-4372-b9d2-e2de2f9a3a26 req-199e9291-0ad8-4515-b435-ac2f91e8a55d service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] No waiting events found dispatching network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:54 user nova-compute[73144]: WARNING nova.compute.manager [req-47e24019-97aa-4372-b9d2-e2de2f9a3a26 req-199e9291-0ad8-4515-b435-ac2f91e8a55d service nova] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Received unexpected event network-vif-plugged-cebad443-da70-41b3-aaee-7f539f336c43 for instance with vm_state deleted and task_state None.
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a54eca5-c651-4b85-bcd1-4bb82d8d49fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260]
Aug 14 22:06:54 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260] successful.
Aug 14 22:06:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4229b2-0712-4f9e-99e5-e22bd5365ada]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb77e31-0875-4217-99e0-62633e7a057a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:06:54 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a1112b-e0ee-43c0-beed-1b77f64bf1ad]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:06:54 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzGCMOKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26132663331396465', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132663331396465', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2101394125',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2101394125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2101394125',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiVliqQL7MwUfoAw0B3OVBZPYa0NKnhwD6PYyMkqYAbtLNs9DD0OD1F67SJm8GCUxWffIeRB6EP6lcP+Bkh4/CK40TWF1IfqsYDrXSONEubzl5R39fGNRMYyS4xpAKiew==',key_name='tempest-keypair-1952391104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-q73tclir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=852ffbb8-7a08-425e-b1af-78db45d7313e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0b:7a,bridge_name='br-int',has_traffic_filtering=True,id=8845dd0a-60ec-47c8-ab1a-70b7efd35560,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dd0a-60') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.objects.instance [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'pci_devices' on Instance uuid 852ffbb8-7a08-425e-b1af-78db45d7313e {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:06:55 user nova-compute[73144]:   <uuid>852ffbb8-7a08-425e-b1af-78db45d7313e</uuid>
Aug 14 22:06:55 user nova-compute[73144]:   <name>instance-0000002b</name>
Aug 14 22:06:55 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:06:55 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:06:55 user nova-compute[73144]:   <metadata>
Aug 14 22:06:55 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:06:55 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:06:55 user nova-compute[73144]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2101394125</nova:name>
Aug 14 22:06:55 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:06:53</nova:creationTime>
Aug 14 22:06:55 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:06:55 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:06:55 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:06:55 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:06:55 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:06:55 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:06:55 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:06:55 user nova-compute[73144]:       <nova:owner>
Aug 14 22:06:55 user nova-compute[73144]:         <nova:user uuid="52a3e93f724b43a08ee42b79c63ed4d0">tempest-TestVolumeBootPattern-790116957-project-member</nova:user>
Aug 14 22:06:55 user nova-compute[73144]:         <nova:project uuid="0f796a65843b467a9889f47789c87eed">tempest-TestVolumeBootPattern-790116957</nova:project>
Aug 14 22:06:55 user nova-compute[73144]:       </nova:owner>
Aug 14 22:06:55 user nova-compute[73144]:       <nova:ports>
Aug 14 22:06:55 user nova-compute[73144]:         <nova:port uuid="8845dd0a-60ec-47c8-ab1a-70b7efd35560">
Aug 14 22:06:55 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 22:06:55 user nova-compute[73144]:         </nova:port>
Aug 14 22:06:55 user nova-compute[73144]:       </nova:ports>
Aug 14 22:06:55 user nova-compute[73144]:     </nova:instance>
Aug 14 22:06:55 user nova-compute[73144]:   </metadata>
Aug 14 22:06:55 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:06:55 user nova-compute[73144]:     <system>
Aug 14 22:06:55 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:06:55 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:06:55 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:06:55 user nova-compute[73144]:       <entry name="serial">852ffbb8-7a08-425e-b1af-78db45d7313e</entry>
Aug 14 22:06:55 user nova-compute[73144]:       <entry name="uuid">852ffbb8-7a08-425e-b1af-78db45d7313e</entry>
Aug 14 22:06:55 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:06:55 user nova-compute[73144]:     </system>
Aug 14 22:06:55 user nova-compute[73144]:   </sysinfo>
Aug 14 22:06:55 user nova-compute[73144]:   <os>
Aug 14 22:06:55 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:06:55 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:06:55 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:06:55 user nova-compute[73144]:   </os>
Aug 14 22:06:55 user nova-compute[73144]:   <features>
Aug 14 22:06:55 user nova-compute[73144]:     <acpi/>
Aug 14 22:06:55 user nova-compute[73144]:     <apic/>
Aug 14 22:06:55 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:06:55 user nova-compute[73144]:   </features>
Aug 14 22:06:55 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:06:55 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:06:55 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:06:55 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:06:55 user nova-compute[73144]:   </clock>
Aug 14 22:06:55 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:06:55 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:06:55 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:06:55 user nova-compute[73144]:   </cpu>
Aug 14 22:06:55 user nova-compute[73144]:   <devices>
Aug 14 22:06:55 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:06:55 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:06:55 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 22:06:55 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:06:55 user nova-compute[73144]:       <serial>08419ad9-939f-4eb5-bd2f-959f3d5b6236</serial>
Aug 14 22:06:55 user nova-compute[73144]:     </disk>
Aug 14 22:06:55 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:06:55 user nova-compute[73144]:       <mac address="fa:16:3e:8e:0b:7a"/>
Aug 14 22:06:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:06:55 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:06:55 user nova-compute[73144]:       <target dev="tap8845dd0a-60"/>
Aug 14 22:06:55 user nova-compute[73144]:     </interface>
Aug 14 22:06:55 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:06:55 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/852ffbb8-7a08-425e-b1af-78db45d7313e/console.log" append="off"/>
Aug 14 22:06:55 user nova-compute[73144]:     </serial>
Aug 14 22:06:55 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:06:55 user nova-compute[73144]:     <video>
Aug 14 22:06:55 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:06:55 user nova-compute[73144]:     </video>
Aug 14 22:06:55 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:06:55 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:06:55 user nova-compute[73144]:     </rng>
Aug 14 22:06:55 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:06:55 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:06:55 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:06:55 user nova-compute[73144]:     </memballoon>
Aug 14 22:06:55 user nova-compute[73144]:   </devices>
Aug 14 22:06:55 user nova-compute[73144]: </domain>
Aug 14 22:06:55 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2101394125',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2101394125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2101394125',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiVliqQL7MwUfoAw0B3OVBZPYa0NKnhwD6PYyMkqYAbtLNs9DD0OD1F67SJm8GCUxWffIeRB6EP6lcP+Bkh4/CK40TWF1IfqsYDrXSONEubzl5R39fGNRMYyS4xpAKiew==',key_name='tempest-keypair-1952391104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-q73tclir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=852ffbb8-7a08-425e-b1af-78db45d7313e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0b:7a,bridge_name='br-int',has_traffic_filtering=True,id=8845dd0a-60ec-47c8-ab1a-70b7efd35560,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dd0a-60') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG os_vif [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0b:7a,bridge_name='br-int',has_traffic_filtering=True,id=8845dd0a-60ec-47c8-ab1a-70b7efd35560,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dd0a-60') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8845dd0a-60, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8845dd0a-60, col_values=(('external_ids', {'iface-id': '8845dd0a-60ec-47c8-ab1a-70b7efd35560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:0b:7a', 'vm-uuid': '852ffbb8-7a08-425e-b1af-78db45d7313e'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:55 user nova-compute[73144]: INFO os_vif [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:0b:7a,bridge_name='br-int',has_traffic_filtering=True,id=8845dd0a-60ec-47c8-ab1a-70b7efd35560,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dd0a-60')
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:06:55 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No VIF found with MAC fa:16:3e:8e:0b:7a, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:06:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-6ef698da-c08f-4b1a-b78a-78d98ed49265 req-6cb4d1b2-1ef7-4d32-addc-322315889b9f service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6ef698da-c08f-4b1a-b78a-78d98ed49265 req-6cb4d1b2-1ef7-4d32-addc-322315889b9f service nova] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6ef698da-c08f-4b1a-b78a-78d98ed49265 req-6cb4d1b2-1ef7-4d32-addc-322315889b9f service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6ef698da-c08f-4b1a-b78a-78d98ed49265 req-6cb4d1b2-1ef7-4d32-addc-322315889b9f service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-6ef698da-c08f-4b1a-b78a-78d98ed49265 req-6cb4d1b2-1ef7-4d32-addc-322315889b9f service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] No waiting events found dispatching network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:57 user nova-compute[73144]: WARNING nova.compute.manager [req-6ef698da-c08f-4b1a-b78a-78d98ed49265 req-6cb4d1b2-1ef7-4d32-addc-322315889b9f service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received unexpected event network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 for instance with vm_state building and task_state spawning.
Aug 14 22:06:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050818.8468518, 852ffbb8-7a08-425e-b1af-78db45d7313e => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:06:58 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] VM Resumed (Lifecycle Event)
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:06:58 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Instance spawned successfully.
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:06:58 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050818.85073, 852ffbb8-7a08-425e-b1af-78db45d7313e => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:06:58 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] VM Started (Lifecycle Event)
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:06:58 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:06:58 user nova-compute[73144]: INFO nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 14 22:06:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:06:59 user nova-compute[73144]: INFO nova.compute.manager [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Took 15.01 seconds to build instance.
Aug 14 22:06:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8adbcbab-b0c9-4773-a9a5-30fbc32ebdbf tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.102s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-141e0278-adb7-487a-8995-72cff8d61291 req-eeb7a0c0-5b44-4bb0-ada4-ea2121494ea8 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:06:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-141e0278-adb7-487a-8995-72cff8d61291 req-eeb7a0c0-5b44-4bb0-ada4-ea2121494ea8 service nova] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:06:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-141e0278-adb7-487a-8995-72cff8d61291 req-eeb7a0c0-5b44-4bb0-ada4-ea2121494ea8 service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:06:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-141e0278-adb7-487a-8995-72cff8d61291 req-eeb7a0c0-5b44-4bb0-ada4-ea2121494ea8 service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:06:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-141e0278-adb7-487a-8995-72cff8d61291 req-eeb7a0c0-5b44-4bb0-ada4-ea2121494ea8 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] No waiting events found dispatching network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:06:59 user nova-compute[73144]: WARNING nova.compute.manager [req-141e0278-adb7-487a-8995-72cff8d61291 req-eeb7a0c0-5b44-4bb0-ada4-ea2121494ea8 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received unexpected event network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 for instance with vm_state active and task_state None.
Aug 14 22:07:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "ef7cd461-517e-458c-a22a-d226daf54347" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:06 user nova-compute[73144]: INFO nova.compute.manager [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Terminating instance
Aug 14 22:07:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-aeea0d63-3505-4032-8edf-e8e413e9c822 req-4bda0638-6168-4f7b-8b25-13060be0917b service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-unplugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aeea0d63-3505-4032-8edf-e8e413e9c822 req-4bda0638-6168-4f7b-8b25-13060be0917b service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aeea0d63-3505-4032-8edf-e8e413e9c822 req-4bda0638-6168-4f7b-8b25-13060be0917b service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-aeea0d63-3505-4032-8edf-e8e413e9c822 req-4bda0638-6168-4f7b-8b25-13060be0917b service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-aeea0d63-3505-4032-8edf-e8e413e9c822 req-4bda0638-6168-4f7b-8b25-13060be0917b service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-unplugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:07:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-aeea0d63-3505-4032-8edf-e8e413e9c822 req-4bda0638-6168-4f7b-8b25-13060be0917b service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-unplugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Instance destroyed successfully.
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.objects.instance [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'resources' on Instance uuid ef7cd461-517e-458c-a22a-d226daf54347 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1484744198',display_name='tempest-ServerRescueNegativeTestJSON-server-1484744198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1484744198',id=21,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-aky6v03n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:52:39Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=ef7cd461-517e-458c-a22a-d226daf54347,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "4e4e40c9-2a43-419d-b137-1ffaef720831", "address": "fa:16:3e:fc:b4:58", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e40c9-2a", "ovs_interfaceid": "4e4e40c9-2a43-419d-b137-1ffaef720831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG os_vif [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e4e40c9-2a, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:07 user nova-compute[73144]: INFO os_vif [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b4:58,bridge_name='br-int',has_traffic_filtering=True,id=4e4e40c9-2a43-419d-b137-1ffaef720831,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e40c9-2a')
Aug 14 22:07:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Deleting instance files /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347_del
Aug 14 22:07:07 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Deletion of /opt/stack/data/nova/instances/ef7cd461-517e-458c-a22a-d226daf54347_del complete
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050812.3974285, 8098d577-b7b2-4881-aa10-5cca7f5ee0f1 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:07:07 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] VM Stopped (Lifecycle Event)
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6abf9f02-63cb-4a6a-ab15-98cde85037d1 None None] [instance: 8098d577-b7b2-4881-aa10-5cca7f5ee0f1] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:07:07 user nova-compute[73144]: INFO nova.compute.manager [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 22:07:07 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:07:07 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Took 0.49 seconds to deallocate network for instance.
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-b34c8d6f-f91f-45a1-a1cd-1ca7fa12f941 req-72ae8aa3-b9d9-4cb7-80d8-3a64b2bc0b3b service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-deleted-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:07 user nova-compute[73144]: INFO nova.compute.manager [req-b34c8d6f-f91f-45a1-a1cd-1ca7fa12f941 req-72ae8aa3-b9d9-4cb7-80d8-3a64b2bc0b3b service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Neutron deleted interface 4e4e40c9-2a43-419d-b137-1ffaef720831; detaching it from the instance and deleting it from the info cache
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.network.neutron [req-b34c8d6f-f91f-45a1-a1cd-1ca7fa12f941 req-72ae8aa3-b9d9-4cb7-80d8-3a64b2bc0b3b service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:07:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-b34c8d6f-f91f-45a1-a1cd-1ca7fa12f941 req-72ae8aa3-b9d9-4cb7-80d8-3a64b2bc0b3b service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Detach interface failed, port_id=4e4e40c9-2a43-419d-b137-1ffaef720831, reason: Instance ef7cd461-517e-458c-a22a-d226daf54347 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:08 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Deleted allocations for instance ef7cd461-517e-458c-a22a-d226daf54347
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-92ee8fec-9489-4d17-b47a-693cdcd1865e tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "ef7cd461-517e-458c-a22a-d226daf54347" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-44797bdd-7df7-4f3c-9461-e4254f05ffd0 req-a9c94e68-8feb-4f34-893d-06488b06fa8c service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-44797bdd-7df7-4f3c-9461-e4254f05ffd0 req-a9c94e68-8feb-4f34-893d-06488b06fa8c service nova] Acquiring lock "ef7cd461-517e-458c-a22a-d226daf54347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-44797bdd-7df7-4f3c-9461-e4254f05ffd0 req-a9c94e68-8feb-4f34-893d-06488b06fa8c service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-44797bdd-7df7-4f3c-9461-e4254f05ffd0 req-a9c94e68-8feb-4f34-893d-06488b06fa8c service nova] Lock "ef7cd461-517e-458c-a22a-d226daf54347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-44797bdd-7df7-4f3c-9461-e4254f05ffd0 req-a9c94e68-8feb-4f34-893d-06488b06fa8c service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] No waiting events found dispatching network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:07:08 user nova-compute[73144]: WARNING nova.compute.manager [req-44797bdd-7df7-4f3c-9461-e4254f05ffd0 req-a9c94e68-8feb-4f34-893d-06488b06fa8c service nova] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Received unexpected event network-vif-plugged-4e4e40c9-2a43-419d-b137-1ffaef720831 for instance with vm_state deleted and task_state None.
Aug 14 22:07:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:10 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:07:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:07:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:16 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:07:16 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=24.840404510498047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9a143491-b86c-4768-9014-306bbeee8ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c0cb840-2ddf-4a02-9a74-92339044bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 852ffbb8-7a08-425e-b1af-78db45d7313e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:07:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:07:18 user nova-compute[73144]: INFO nova.compute.claims [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Claim successful on node user
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [{"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-5229a303-2dad-45a6-b140-29a55d8d29a7" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:07:18 user nova-compute[73144]: DEBUG nova.network.neutron [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:07:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.policy [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43342fae8732443c990af06487af5c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17398a626e67472e81402db4abe498e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:07:19 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Creating image(s)
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "/opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "/opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk 1073741824" returned: 0 in 0.058s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Successfully created port: 5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Cannot resize image /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.objects.instance [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lazy-loading 'migration_context' on Instance uuid 0cb7079f-38f0-47a8-bf5b-6a90269384f8 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Ensure instance console log exists: /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Successfully updated port: 5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "refresh_cache-0cb7079f-38f0-47a8-bf5b-6a90269384f8" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquired lock "refresh_cache-0cb7079f-38f0-47a8-bf5b-6a90269384f8" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received event network-changed-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Refreshing instance network info cache due to event network-changed-5d9ebf66-4807-4973-990d-ed14ad19225e. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] Acquiring lock "refresh_cache-0cb7079f-38f0-47a8-bf5b-6a90269384f8" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Updating instance_info_cache with network_info: [{"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Releasing lock "refresh_cache-0cb7079f-38f0-47a8-bf5b-6a90269384f8" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Instance network_info: |[{"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] Acquired lock "refresh_cache-0cb7079f-38f0-47a8-bf5b-6a90269384f8" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.neutron [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Refreshing network info cache for port 5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Start _get_guest_xml network_info=[{"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:07:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:07:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1220962728',display_name='tempest-ServersNegativeTestJSON-server-1220962728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1220962728',id=44,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17398a626e67472e81402db4abe498e1',ramdisk_id='',reservation_id='r-g074lwtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712834715',owner_user_name='tempest-ServersNegativeTestJSON-1712834715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:07:19Z,user_data=None,user_id='43342fae8732443c990af06487af5c0b',uuid=0cb7079f-38f0-47a8-bf5b-6a90269384f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converting VIF {"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:34:d6,bridge_name='br-int',has_traffic_filtering=True,id=5d9ebf66-4807-4973-990d-ed14ad19225e,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9ebf66-48') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.objects.instance [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cb7079f-38f0-47a8-bf5b-6a90269384f8 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:07:20 user nova-compute[73144]:   <uuid>0cb7079f-38f0-47a8-bf5b-6a90269384f8</uuid>
Aug 14 22:07:20 user nova-compute[73144]:   <name>instance-0000002c</name>
Aug 14 22:07:20 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:07:20 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:07:20 user nova-compute[73144]:   <metadata>
Aug 14 22:07:20 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:07:20 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:07:20 user nova-compute[73144]:       <nova:name>tempest-ServersNegativeTestJSON-server-1220962728</nova:name>
Aug 14 22:07:20 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:07:20</nova:creationTime>
Aug 14 22:07:20 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:07:20 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:07:20 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:07:20 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:07:20 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:07:20 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:07:20 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:07:20 user nova-compute[73144]:       <nova:owner>
Aug 14 22:07:20 user nova-compute[73144]:         <nova:user uuid="43342fae8732443c990af06487af5c0b">tempest-ServersNegativeTestJSON-1712834715-project-member</nova:user>
Aug 14 22:07:20 user nova-compute[73144]:         <nova:project uuid="17398a626e67472e81402db4abe498e1">tempest-ServersNegativeTestJSON-1712834715</nova:project>
Aug 14 22:07:20 user nova-compute[73144]:       </nova:owner>
Aug 14 22:07:20 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:07:20 user nova-compute[73144]:       <nova:ports>
Aug 14 22:07:20 user nova-compute[73144]:         <nova:port uuid="5d9ebf66-4807-4973-990d-ed14ad19225e">
Aug 14 22:07:20 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 22:07:20 user nova-compute[73144]:         </nova:port>
Aug 14 22:07:20 user nova-compute[73144]:       </nova:ports>
Aug 14 22:07:20 user nova-compute[73144]:     </nova:instance>
Aug 14 22:07:20 user nova-compute[73144]:   </metadata>
Aug 14 22:07:20 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:07:20 user nova-compute[73144]:     <system>
Aug 14 22:07:20 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:07:20 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:07:20 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:07:20 user nova-compute[73144]:       <entry name="serial">0cb7079f-38f0-47a8-bf5b-6a90269384f8</entry>
Aug 14 22:07:20 user nova-compute[73144]:       <entry name="uuid">0cb7079f-38f0-47a8-bf5b-6a90269384f8</entry>
Aug 14 22:07:20 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:07:20 user nova-compute[73144]:     </system>
Aug 14 22:07:20 user nova-compute[73144]:   </sysinfo>
Aug 14 22:07:20 user nova-compute[73144]:   <os>
Aug 14 22:07:20 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:07:20 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:07:20 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:07:20 user nova-compute[73144]:   </os>
Aug 14 22:07:20 user nova-compute[73144]:   <features>
Aug 14 22:07:20 user nova-compute[73144]:     <acpi/>
Aug 14 22:07:20 user nova-compute[73144]:     <apic/>
Aug 14 22:07:20 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:07:20 user nova-compute[73144]:   </features>
Aug 14 22:07:20 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:07:20 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:07:20 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:07:20 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:07:20 user nova-compute[73144]:   </clock>
Aug 14 22:07:20 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:07:20 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:07:20 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:07:20 user nova-compute[73144]:   </cpu>
Aug 14 22:07:20 user nova-compute[73144]:   <devices>
Aug 14 22:07:20 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:07:20 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:07:20 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk"/>
Aug 14 22:07:20 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:07:20 user nova-compute[73144]:     </disk>
Aug 14 22:07:20 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:07:20 user nova-compute[73144]:       <mac address="fa:16:3e:39:34:d6"/>
Aug 14 22:07:20 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:07:20 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:07:20 user nova-compute[73144]:       <target dev="tap5d9ebf66-48"/>
Aug 14 22:07:20 user nova-compute[73144]:     </interface>
Aug 14 22:07:20 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:07:20 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/console.log" append="off"/>
Aug 14 22:07:20 user nova-compute[73144]:     </serial>
Aug 14 22:07:20 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:07:20 user nova-compute[73144]:     <video>
Aug 14 22:07:20 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:07:20 user nova-compute[73144]:     </video>
Aug 14 22:07:20 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:07:20 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:07:20 user nova-compute[73144]:     </rng>
Aug 14 22:07:20 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:07:20 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:07:20 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:07:20 user nova-compute[73144]:     </memballoon>
Aug 14 22:07:20 user nova-compute[73144]:   </devices>
Aug 14 22:07:20 user nova-compute[73144]: </domain>
Aug 14 22:07:20 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1220962728',display_name='tempest-ServersNegativeTestJSON-server-1220962728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1220962728',id=44,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17398a626e67472e81402db4abe498e1',ramdisk_id='',reservation_id='r-g074lwtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712834715',owner_user_name='tempest-ServersNegativeTestJSON-1712834715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:07:19Z,user_data=None,user_id='43342fae8732443c990af06487af5c0b',uuid=0cb7079f-38f0-47a8-bf5b-6a90269384f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converting VIF {"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:34:d6,bridge_name='br-int',has_traffic_filtering=True,id=5d9ebf66-4807-4973-990d-ed14ad19225e,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9ebf66-48') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG os_vif [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:34:d6,bridge_name='br-int',has_traffic_filtering=True,id=5d9ebf66-4807-4973-990d-ed14ad19225e,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9ebf66-48') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d9ebf66-48, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d9ebf66-48, col_values=(('external_ids', {'iface-id': '5d9ebf66-4807-4973-990d-ed14ad19225e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:34:d6', 'vm-uuid': '0cb7079f-38f0-47a8-bf5b-6a90269384f8'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:20 user nova-compute[73144]: INFO os_vif [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:34:d6,bridge_name='br-int',has_traffic_filtering=True,id=5d9ebf66-4807-4973-990d-ed14ad19225e,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9ebf66-48')
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:07:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] No VIF found with MAC fa:16:3e:39:34:d6, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:07:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Updated VIF entry in instance network info cache for port 5d9ebf66-4807-4973-990d-ed14ad19225e. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:07:21 user nova-compute[73144]: DEBUG nova.network.neutron [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Updating instance_info_cache with network_info: [{"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:07:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-457cd0df-330d-44cf-bc18-6d9ffff7c850 req-350b9f09-f3f4-426c-8ad1-4d41fa2e746c service nova] Releasing lock "refresh_cache-0cb7079f-38f0-47a8-bf5b-6a90269384f8" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:07:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:22 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050827.335957, ef7cd461-517e-458c-a22a-d226daf54347 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:07:22 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: ef7cd461-517e-458c-a22a-d226daf54347] VM Stopped (Lifecycle Event)
Aug 14 22:07:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-728bfe85-6062-4250-addf-7356b2cdb1fc None None] [instance: ef7cd461-517e-458c-a22a-d226daf54347] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:07:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-56d3879e-2e84-4c06-82d9-b9eb462723d8 req-bc7fd3e0-77e8-4558-9092-9d32f3780c4f service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received event network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56d3879e-2e84-4c06-82d9-b9eb462723d8 req-bc7fd3e0-77e8-4558-9092-9d32f3780c4f service nova] Acquiring lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56d3879e-2e84-4c06-82d9-b9eb462723d8 req-bc7fd3e0-77e8-4558-9092-9d32f3780c4f service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-56d3879e-2e84-4c06-82d9-b9eb462723d8 req-bc7fd3e0-77e8-4558-9092-9d32f3780c4f service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-56d3879e-2e84-4c06-82d9-b9eb462723d8 req-bc7fd3e0-77e8-4558-9092-9d32f3780c4f service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] No waiting events found dispatching network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:07:23 user nova-compute[73144]: WARNING nova.compute.manager [req-56d3879e-2e84-4c06-82d9-b9eb462723d8 req-bc7fd3e0-77e8-4558-9092-9d32f3780c4f service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received unexpected event network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e for instance with vm_state building and task_state spawning.
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050844.5744214, 0cb7079f-38f0-47a8-bf5b-6a90269384f8 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:07:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] VM Resumed (Lifecycle Event)
Aug 14 22:07:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:07:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Instance spawned successfully.
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:07:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050844.5761378, 0cb7079f-38f0-47a8-bf5b-6a90269384f8 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:07:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] VM Started (Lifecycle Event)
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:07:24 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:07:24 user nova-compute[73144]: INFO nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:07:24 user nova-compute[73144]: INFO nova.compute.manager [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Took 6.32 seconds to build instance.
Aug 14 22:07:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-591d2c87-9b3d-46a5-a912-8240cd34fa15 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.589s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:07:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:25 user nova-compute[73144]: INFO nova.compute.manager [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attaching volume d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 to /dev/vdb
Aug 14 22:07:25 user nova-compute[73144]: DEBUG os_brick.utils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa813fb1-22b4-456c-b9f4-f423b37ff016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b2604a-84e6-4bd2-abbc-8f7fb91c166e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac5d587-3360-4be9-ac6f-83ef000a3ff2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf701e-72b6-4217-ad6c-c87f6508e95c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-a2a32e5e-7f9b-4469-9f5b-119c30dd8d16 req-cbee32f1-04b3-43ab-991e-9e910d563f1c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received event network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a2a32e5e-7f9b-4469-9f5b-119c30dd8d16 req-cbee32f1-04b3-43ab-991e-9e910d563f1c service nova] Acquiring lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a2a32e5e-7f9b-4469-9f5b-119c30dd8d16 req-cbee32f1-04b3-43ab-991e-9e910d563f1c service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a2a32e5e-7f9b-4469-9f5b-119c30dd8d16 req-cbee32f1-04b3-43ab-991e-9e910d563f1c service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-a2a32e5e-7f9b-4469-9f5b-119c30dd8d16 req-cbee32f1-04b3-43ab-991e-9e910d563f1c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] No waiting events found dispatching network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:07:25 user nova-compute[73144]: WARNING nova.compute.manager [req-a2a32e5e-7f9b-4469-9f5b-119c30dd8d16 req-cbee32f1-04b3-43ab-991e-9e910d563f1c service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received unexpected event network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e for instance with vm_state active and task_state None.
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:07:25 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:07:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e04dd-8979-40bc-a023-99f2280b664d]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG os_brick.utils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating existing volume attachment record: 919082ad-1bd1-4ef4-b8a1-60e28617b3b2 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:07:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrQSpfTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:07:33 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:07:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:07:33 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:07:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:07:33 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:07:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a135af-dc48-4ab4-9835-614023c123b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:07:33 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:33 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b908f3-f040-4bb3-b444-e0afab813a7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561] added
Aug 14 22:07:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3968ecc-d4c9-4441-88ca-d5856f0c9466]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2334cd-7b4d-402b-9597-590e564e8a6a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VrQSpfTw {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VrQSpfTw" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f67d0-db43-4d56-88ee-3ef47630fbc3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VrQSpfTw'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[726b0482-aec1-458d-9d7f-49fa1478cfaa]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaefec1-4143-4519-9db6-bf47e8dc244d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63df44c-a19d-4cf3-aa72-eed1b91a8c00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260]
Aug 14 22:07:34 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260] successful.
Aug 14 22:07:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd0b29c-b0cd-462b-bffc-5f75ea44514f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[060dde79-48bc-4990-b258-afbf7c6fd3ac]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 (non-flash)
Aug 14 22:07:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e6dbd-e5ef-472a-803c-9a6b26f73ec5]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrQSpfTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23365643265373231', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365643265373231', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:07:35 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:07:35 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:07:35 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:07:35 user nova-compute[73144]:   <serial>d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561</serial>
Aug 14 22:07:35 user nova-compute[73144]: </disk>
Aug 14 22:07:35 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] No VIF found with MAC fa:16:3e:98:44:55, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1059f999-0b19-4fba-bfb9-1144bbe5ddd7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.839s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:38 user nova-compute[73144]: INFO nova.compute.manager [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Detaching volume d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561
Aug 14 22:07:38 user nova-compute[73144]: INFO nova.virt.block_device [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Attempting to driver detach volume d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 from mountpoint /dev/vdb
Aug 14 22:07:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Attempting to detach device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:07:38 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:07:38 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:07:38 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:07:38 user nova-compute[73144]:   <serial>d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561</serial>
Aug 14 22:07:38 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:07:38 user nova-compute[73144]: </disk>
Aug 14 22:07:38 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:07:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the persistent domain config.
Aug 14 22:07:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:07:38 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:07:38 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:07:38 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:07:38 user nova-compute[73144]:   <serial>d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561</serial>
Aug 14 22:07:38 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:07:38 user nova-compute[73144]: </disk>
Aug 14 22:07:38 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692050858.9361556, e5f03cb8-f350-4e69-af26-1a40519be4da => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:07:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully detached device vdb from instance e5f03cb8-f350-4e69-af26-1a40519be4da from the live domain config.
Aug 14 22:07:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrQSpfTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:07:38 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:07:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbdd877-b6fa-4845-ac1b-0b51906dc533]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fff2369-e49c-43b6-8ac5-967dfb507e7b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 (non-flash)
Aug 14 22:07:39 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1583dacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade101e5-0fd7-4b0c-b608-9cc0e2369ce7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.044s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e096f-921a-4494-8517-d3f1fefa39ce]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[358d34a8-d86a-4c91-a942-bc4f1c8deaac]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba8981-003f-4077-bb06-023f504779d8]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a5625-ce47-481a-ba69-4c39de350531]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf92c0-a765-4a19-a081-6b9d45e2cb6b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260]
Aug 14 22:07:39 user nova-compute[73144]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561, portal: 172.16.0.220,3260] successful.
Aug 14 22:07:39 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b2ca5e-e22c-4ed0-9d37-1a7f73aef561 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c0222-ef91-4769-b643-3f878526dd20]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] <== disconnect_volume: return (352ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:07:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:07:40 user nova-compute[73144]: DEBUG nova.objects.instance [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'flavor' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:07:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5e4f406e-9002-4778-bb8e-81042015e7e7 tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:57 user nova-compute[73144]: INFO nova.compute.manager [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Terminating instance
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.compute.manager [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-d9a905f4-95a6-445f-b978-1b4f958fae8c req-fd32e3ae-e31e-4710-91d9-523300fba542 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d9a905f4-95a6-445f-b978-1b4f958fae8c req-fd32e3ae-e31e-4710-91d9-523300fba542 service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d9a905f4-95a6-445f-b978-1b4f958fae8c req-fd32e3ae-e31e-4710-91d9-523300fba542 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d9a905f4-95a6-445f-b978-1b4f958fae8c req-fd32e3ae-e31e-4710-91d9-523300fba542 service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-d9a905f4-95a6-445f-b978-1b4f958fae8c req-fd32e3ae-e31e-4710-91d9-523300fba542 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-d9a905f4-95a6-445f-b978-1b4f958fae8c req-fd32e3ae-e31e-4710-91d9-523300fba542 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-unplugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Instance destroyed successfully.
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.objects.instance [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lazy-loading 'resources' on Instance uuid 9a143491-b86c-4768-9014-306bbeee8ad9 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-733506174',display_name='tempest-ServerRescueNegativeTestJSON-server-733506174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-733506174',id=20,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc2faa54982470a8ff513ec75cf0546',ramdisk_id='',reservation_id='r-ljinwyz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-89538024',owner_user_name='tempest-ServerRescueNegativeTestJSON-89538024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:57:24Z,user_data=None,user_id='8d90a89f0b384bfbbabfc57e098efc45',uuid=9a143491-b86c-4768-9014-306bbeee8ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converting VIF {"id": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "address": "fa:16:3e:ff:51:af", "network": {"id": "4f439887-2dce-4c6d-b3b0-4d42bbab20bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-398774764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc2faa54982470a8ff513ec75cf0546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78b43d-4f", "ovs_interfaceid": "fc78b43d-4f53-4973-bd15-95772d01fdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG os_vif [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc78b43d-4f, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:07:57 user nova-compute[73144]: INFO os_vif [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:51:af,bridge_name='br-int',has_traffic_filtering=True,id=fc78b43d-4f53-4973-bd15-95772d01fdf7,network=Network(4f439887-2dce-4c6d-b3b0-4d42bbab20bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78b43d-4f')
Aug 14 22:07:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Deleting instance files /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9_del
Aug 14 22:07:57 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Deletion of /opt/stack/data/nova/instances/9a143491-b86c-4768-9014-306bbeee8ad9_del complete
Aug 14 22:07:57 user nova-compute[73144]: INFO nova.compute.manager [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 14 22:07:57 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:07:57 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:07:58 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:07:58 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Took 0.45 seconds to deallocate network for instance.
Aug 14 22:07:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-d993cfc1-948a-4a7a-88a1-4cafc2b4bb53 req-264eac9a-d5b9-4dec-b29b-bf1fab58ecc3 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-deleted-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:58 user nova-compute[73144]: INFO nova.compute.manager [req-d993cfc1-948a-4a7a-88a1-4cafc2b4bb53 req-264eac9a-d5b9-4dec-b29b-bf1fab58ecc3 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Neutron deleted interface fc78b43d-4f53-4973-bd15-95772d01fdf7; detaching it from the instance and deleting it from the info cache
Aug 14 22:07:58 user nova-compute[73144]: DEBUG nova.network.neutron [req-d993cfc1-948a-4a7a-88a1-4cafc2b4bb53 req-264eac9a-d5b9-4dec-b29b-bf1fab58ecc3 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:07:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-d993cfc1-948a-4a7a-88a1-4cafc2b4bb53 req-264eac9a-d5b9-4dec-b29b-bf1fab58ecc3 service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Detach interface failed, port_id=fc78b43d-4f53-4973-bd15-95772d01fdf7, reason: Instance 9a143491-b86c-4768-9014-306bbeee8ad9 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:07:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:58 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:07:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:07:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:58 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Deleted allocations for instance 9a143491-b86c-4768-9014-306bbeee8ad9
Aug 14 22:07:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-57abe933-cefb-4509-95ef-8025898ae586 tempest-ServerRescueNegativeTestJSON-89538024 tempest-ServerRescueNegativeTestJSON-89538024-project-member] Lock "9a143491-b86c-4768-9014-306bbeee8ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.921s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-ac38d23d-dcb1-4622-b6ca-b6b778586364 req-5b017c10-93f1-4391-b1f6-98b88f43d8dc service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:07:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ac38d23d-dcb1-4622-b6ca-b6b778586364 req-5b017c10-93f1-4391-b1f6-98b88f43d8dc service nova] Acquiring lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:07:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ac38d23d-dcb1-4622-b6ca-b6b778586364 req-5b017c10-93f1-4391-b1f6-98b88f43d8dc service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:07:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ac38d23d-dcb1-4622-b6ca-b6b778586364 req-5b017c10-93f1-4391-b1f6-98b88f43d8dc service nova] Lock "9a143491-b86c-4768-9014-306bbeee8ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:07:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-ac38d23d-dcb1-4622-b6ca-b6b778586364 req-5b017c10-93f1-4391-b1f6-98b88f43d8dc service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] No waiting events found dispatching network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:07:59 user nova-compute[73144]: WARNING nova.compute.manager [req-ac38d23d-dcb1-4622-b6ca-b6b778586364 req-5b017c10-93f1-4391-b1f6-98b88f43d8dc service nova] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Received unexpected event network-vif-plugged-fc78b43d-4f53-4973-bd15-95772d01fdf7 for instance with vm_state deleted and task_state None.
Aug 14 22:08:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:10 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:11 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:08:12 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050877.8589497, 9a143491-b86c-4768-9014-306bbeee8ad9 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:08:12 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] VM Stopped (Lifecycle Event)
Aug 14 22:08:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-aa339139-a4ee-4a3d-a40f-0684e0f31fba None None] [instance: 9a143491-b86c-4768-9014-306bbeee8ad9] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:08:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:08:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:08:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:08:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:08:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:14 user nova-compute[73144]: INFO nova.compute.manager [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Terminating instance
Aug 14 22:08:14 user nova-compute[73144]: DEBUG nova.compute.manager [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-ce624363-5bcc-48e4-b9ad-cd38c98e33f7 req-bb4831de-89de-4c3b-8bd7-2a66e3856321 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ce624363-5bcc-48e4-b9ad-cd38c98e33f7 req-bb4831de-89de-4c3b-8bd7-2a66e3856321 service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ce624363-5bcc-48e4-b9ad-cd38c98e33f7 req-bb4831de-89de-4c3b-8bd7-2a66e3856321 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ce624363-5bcc-48e4-b9ad-cd38c98e33f7 req-bb4831de-89de-4c3b-8bd7-2a66e3856321 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-ce624363-5bcc-48e4-b9ad-cd38c98e33f7 req-bb4831de-89de-4c3b-8bd7-2a66e3856321 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-ce624363-5bcc-48e4-b9ad-cd38c98e33f7 req-bb4831de-89de-4c3b-8bd7-2a66e3856321 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-unplugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:08:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Instance destroyed successfully.
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'resources' on Instance uuid 4c0cb840-2ddf-4a02-9a74-92339044bed4 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:02:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-537812427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-537812427',id=39,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:04:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-j7pgyuwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:06:28Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=4c0cb840-2ddf-4a02-9a74-92339044bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "address": "fa:16:3e:c1:c6:28", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529f9817-6a", "ovs_interfaceid": "529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_vif [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap529f9817-6a, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:08:15 user nova-compute[73144]: INFO os_vif [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c6:28,bridge_name='br-int',has_traffic_filtering=True,id=529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529f9817-6a')
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeclJjms', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:08:15 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8231f1-ef17-47b0-a5a3-9791bb1e76e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[213ddbf7-4318-41bb-bcce-dbdf42a5dfa9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:08:15 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:08:15 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:08:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:08:15 user nova-compute[73144]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 (non-flash)
Aug 14 22:08:15 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:08:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa18f08c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0'): ({'sdf'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Removing single pathed devices sdf {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff1af9a-95e6-40ff-a27d-5620a3a4fcf5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf51dd4-2981-4483-9cdf-1c77cdecf202]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flushing IO for device /dev/sdf {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a91ea-6b33-402f-a3e1-800a1c193aa4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d0f6b-a800-43be-b74b-34022b21d180]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] SCSI volumes sdf have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[76917f7d-952e-4744-8f7b-3774c287dcb8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[285be6d7-81ec-42e5-9041-410b569548a1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260]
Aug 14 22:08:15 user nova-compute[73144]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0, portal: 172.16.0.220,3260] successful.
Aug 14 22:08:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f084d871-c546-4c9f-8808-a8e3611341c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ee03fc-b1d2-42ea-8acb-ecaa47ccd3e6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== disconnect_volume: return (356ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:08:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Deleting instance files /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4_del
Aug 14 22:08:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Deletion of /opt/stack/data/nova/instances/4c0cb840-2ddf-4a02-9a74-92339044bed4_del complete
Aug 14 22:08:15 user nova-compute[73144]: INFO nova.compute.manager [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:16 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Took 0.63 seconds to deallocate network for instance.
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:08:16 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Error from libvirt while getting description of instance-00000027: [Error Code 42] Domain not found: no domain with matching uuid '4c0cb840-2ddf-4a02-9a74-92339044bed4' (instance-00000027): libvirt.libvirtError: Domain not found: no domain with matching uuid '4c0cb840-2ddf-4a02-9a74-92339044bed4' (instance-00000027)
Aug 14 22:08:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-c82108f4-3f19-40bc-ab86-dbd6cb31914c req-0d1ae36e-3f45-4c8a-ab6d-583917864988 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c82108f4-3f19-40bc-ab86-dbd6cb31914c req-0d1ae36e-3f45-4c8a-ab6d-583917864988 service nova] Acquiring lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c82108f4-3f19-40bc-ab86-dbd6cb31914c req-0d1ae36e-3f45-4c8a-ab6d-583917864988 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c82108f4-3f19-40bc-ab86-dbd6cb31914c req-0d1ae36e-3f45-4c8a-ab6d-583917864988 service nova] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-c82108f4-3f19-40bc-ab86-dbd6cb31914c req-0d1ae36e-3f45-4c8a-ab6d-583917864988 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] No waiting events found dispatching network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:08:16 user nova-compute[73144]: WARNING nova.compute.manager [req-c82108f4-3f19-40bc-ab86-dbd6cb31914c req-0d1ae36e-3f45-4c8a-ab6d-583917864988 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received unexpected event network-vif-plugged-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f for instance with vm_state active and task_state deleting.
Aug 14 22:08:16 user nova-compute[73144]: DEBUG nova.compute.manager [req-c82108f4-3f19-40bc-ab86-dbd6cb31914c req-0d1ae36e-3f45-4c8a-ab6d-583917864988 service nova] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Received event network-vif-deleted-529f9817-6aa8-4aa9-a6f4-6e956a4bcf3f {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:18 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:08:18 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=24.829437255859375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 87c08427-5779-444e-a6d0-afdc7b5c96ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 4c0cb840-2ddf-4a02-9a74-92339044bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 852ffbb8-7a08-425e-b1af-78db45d7313e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 0cb7079f-38f0-47a8-bf5b-6a90269384f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:08:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:08:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:08:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:08:19 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:08:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Updating instance_info_cache with network_info: [{"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-87c08427-5779-444e-a6d0-afdc7b5c96ca" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:08:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:08:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'flavor' on Instance uuid cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:23 user nova-compute[73144]: INFO nova.compute.manager [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Took 7.10 seconds to detach 1 volumes for instance.
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:23 user nova-compute[73144]: INFO nova.compute.manager [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Attaching volume 2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b to /dev/vdb
Aug 14 22:08:23 user nova-compute[73144]: DEBUG os_brick.utils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a6bf06-7388-4642-8bf1-8349b9db3461]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefff726-cea8-4c67-a07e-1f848537b750]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91fc9b-f728-44ff-b40a-91f10e3dbc38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cdc1fe-e3df-44fe-bfa4-f9d4b1f3fe9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:08:23 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2fa680-500e-4c40-815b-8dc0a49f6612]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG os_brick.utils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating existing volume attachment record: 481f2450-9912-4290-907d-bbe06a4b5bfe {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:23 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Deleted allocations for instance 4c0cb840-2ddf-4a02-9a74-92339044bed4
Aug 14 22:08:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-65adc16a-f753-4e77-802c-8d58bd9ce8ec tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "4c0cb840-2ddf-4a02-9a74-92339044bed4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.539s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:08:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:30 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050895.0211208, 4c0cb840-2ddf-4a02-9a74-92339044bed4 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:08:30 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] VM Stopped (Lifecycle Event)
Aug 14 22:08:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d284d658-496a-44f9-adc6-59d1c2ee3105 None None] [instance: 4c0cb840-2ddf-4a02-9a74-92339044bed4] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-changed-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Refreshing instance network info cache due to event network-changed-8845dd0a-60ec-47c8-ab1a-70b7efd35560. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] Acquiring lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] Acquired lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Refreshing network info cache for port 8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Updated VIF entry in instance network info cache for port 8845dd0a-60ec-47c8-ab1a-70b7efd35560. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Updating instance_info_cache with network_info: [{"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-83020a07-953a-49c5-a74c-5c34391f2df3 req-f54640cb-842c-4073-97b3-f1f0a577218a service nova] Releasing lock "refresh_cache-852ffbb8-7a08-425e-b1af-78db45d7313e" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:08:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:08:46 user nova-compute[73144]: INFO nova.compute.claims [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Claim successful on node user
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:08:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:08:46 user nova-compute[73144]: INFO nova.virt.block_device [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Booting with volume snapshot 6b58458a-3b2b-4c84-bc01-a182bae8a656 at /dev/vda
Aug 14 22:08:46 user nova-compute[73144]: DEBUG nova.policy [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a3e93f724b43a08ee42b79c63ed4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f796a65843b467a9889f47789c87eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:08:47 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Successfully created port: 77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjMsacJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:08:48 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:08:48 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:08:48 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0551d09f-8fee-4fa3-99e9-f8b92eda0192]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:08:48 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d9b83c-4f3d-4a13-a086-ccc6ce5fbfc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b] added
Aug 14 22:08:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[257dd7b5-8f8d-41dd-bfdc-ad1dfb348689]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa5c708-c849-4a10-b2e4-acfcada6a1d0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjMsacJA {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjMsacJA" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fb3909-28a9-43cd-8fea-cba3bea3097e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjMsacJA'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96d898-3ac1-4d69-88f6-f87c992c8f67]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[947384a2-907d-4ef0-84a7-93c4fd5a0523]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a1b11-6bd6-4029-976c-13ecc5f3253e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260]
Aug 14 22:08:48 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260] successful.
Aug 14 22:08:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b53870-8b6b-4be4-ab3b-d3c798d02823]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1392f61e-9cda-4599-8990-18b1da29281d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:08:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:08:48 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:08:48 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9256f5-ad03-4d15-8214-ebcf107dcd22]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Successfully updated port: 77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquired lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-changed-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Refreshing instance network info cache due to event network-changed-77d6a923-8122-48e0-8e32-e0e06e806be1. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] Acquiring lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:08:48 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Updating instance_info_cache with network_info: [{"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Releasing lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Instance network_info: |[{"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] Acquired lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Refreshing network info cache for port 77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjMsacJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '26261663139663330', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261663139663330', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'flavor' on Instance uuid cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:08:49 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:08:49 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:08:49 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:08:49 user nova-compute[73144]:   <serial>2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b</serial>
Aug 14 22:08:49 user nova-compute[73144]: </disk>
Aug 14 22:08:49 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Updated VIF entry in instance network info cache for port 77d6a923-8122-48e0-8e32-e0e06e806be1. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Updating instance_info_cache with network_info: [{"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-9f2f4ec8-bf8f-453d-bb7f-80a0bae44cf2 req-db47d580-4f1f-42cb-bf55-a9e6f2baaaba service nova] Releasing lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:08:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] No VIF found with MAC fa:16:3e:e2:e1:a1, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:08:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f6fce597-2658-44d3-84e6-c6ccb24050f5 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.711s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:08:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:08:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:08:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:08:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:53 user nova-compute[73144]: DEBUG nova.compute.manager [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing instance network info cache due to event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:08:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] Acquiring lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:08:53 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] Acquired lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:08:53 user nova-compute[73144]: DEBUG nova.network.neutron [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:08:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updated VIF entry in instance network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:08:54 user nova-compute[73144]: DEBUG nova.network.neutron [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:54 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a4ffc7d3-d500-4562-84d9-62ab743b3f3b req-062f62d2-60ef-4f13-b937-da50739735f5 service nova] Releasing lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:08:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing instance network info cache due to event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:08:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] Acquiring lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:08:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] Acquired lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:08:55 user nova-compute[73144]: DEBUG nova.network.neutron [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG nova.network.neutron [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updated VIF entry in instance network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG nova.network.neutron [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b4f66a48-5af7-48aa-b7c9-774ca3442ed0 req-62a50c08-4cff-4724-a42d-9ce71950df61 service nova] Releasing lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:56 user nova-compute[73144]: INFO nova.compute.manager [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Rebooting instance
Aug 14 22:08:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquired lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG nova.network.neutron [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG nova.network.neutron [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Releasing lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:08:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG os_brick.utils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e8890-53f7-480b-9c3c-aa5430deb4bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95558f0-9169-4d06-b1f5-9deb1cd3cb2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:57 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d612a7-d002-40b5-ac7d-dab2cc4d3419]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[34703474-58af-479a-966a-de3f7faee2af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:08:58 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:08:58 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e016b1f7-d40d-4a79-b5a2-70fd8155164c]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG os_brick.utils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:08:58 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Updating existing volume attachment record: 55d82924-6231-47bc-afc9-07976bee25d9 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-5dbe42be-e9c7-4751-aad8-24d2a129759a req-703e0b2b-8646-4d20-bcf5-ed3cd442fb32 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-unplugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5dbe42be-e9c7-4751-aad8-24d2a129759a req-703e0b2b-8646-4d20-bcf5-ed3cd442fb32 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5dbe42be-e9c7-4751-aad8-24d2a129759a req-703e0b2b-8646-4d20-bcf5-ed3cd442fb32 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5dbe42be-e9c7-4751-aad8-24d2a129759a req-703e0b2b-8646-4d20-bcf5-ed3cd442fb32 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:08:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-5dbe42be-e9c7-4751-aad8-24d2a129759a req-703e0b2b-8646-4d20-bcf5-ed3cd442fb32 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-unplugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:08:59 user nova-compute[73144]: WARNING nova.compute.manager [req-5dbe42be-e9c7-4751-aad8-24d2a129759a req-703e0b2b-8646-4d20-bcf5-ed3cd442fb32 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received unexpected event network-vif-unplugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with vm_state active and task_state reboot_started.
Aug 14 22:09:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance shutdown successfully.
Aug 14 22:09:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-e07fafd6-de4d-4ec2-87e8-441e570396be req-fb53786e-433a-4168-a579-633ad56a6802 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e07fafd6-de4d-4ec2-87e8-441e570396be req-fb53786e-433a-4168-a579-633ad56a6802 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e07fafd6-de4d-4ec2-87e8-441e570396be req-fb53786e-433a-4168-a579-633ad56a6802 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e07fafd6-de4d-4ec2-87e8-441e570396be req-fb53786e-433a-4168-a579-633ad56a6802 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-e07fafd6-de4d-4ec2-87e8-441e570396be req-fb53786e-433a-4168-a579-633ad56a6802 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:01 user nova-compute[73144]: WARNING nova.compute.manager [req-e07fafd6-de4d-4ec2-87e8-441e570396be req-fb53786e-433a-4168-a579-633ad56a6802 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received unexpected event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with vm_state active and task_state reboot_started.
Aug 14 22:09:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:03 user nova-compute[73144]: WARNING nova.compute.manager [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received unexpected event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with vm_state active and task_state reboot_started.
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:03 user nova-compute[73144]: WARNING nova.compute.manager [req-bda2dde6-de22-42e0-864a-15ad1347dbc1 req-e15b1573-ee21-423f-b717-bbcc3bc746a8 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received unexpected event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with vm_state active and task_state reboot_started.
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Removed pending event for cdec4545-a332-4ea3-ba7e-0af93fac0ff3 due to event {{(pid=73144) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050943.7653801, cdec4545-a332-4ea3-ba7e-0af93fac0ff3 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:09:03 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] VM Resumed (Lifecycle Event)
Aug 14 22:09:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance running successfully.
Aug 14 22:09:03 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance soft rebooted successfully.
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:09:03 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050943.7697675, cdec4545-a332-4ea3-ba7e-0af93fac0ff3 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:09:03 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] VM Started (Lifecycle Event)
Aug 14 22:09:03 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-66fda042-ace8-402a-905d-a210b7263c8d tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.497s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:03 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:05 user nova-compute[73144]: INFO nova.compute.manager [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Terminating instance
Aug 14 22:09:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-f6967575-018c-4731-afc3-7cdc14d7f279 req-0413cb0c-b265-4fb8-8c8f-90ebfda7534d service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received event network-vif-unplugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f6967575-018c-4731-afc3-7cdc14d7f279 req-0413cb0c-b265-4fb8-8c8f-90ebfda7534d service nova] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f6967575-018c-4731-afc3-7cdc14d7f279 req-0413cb0c-b265-4fb8-8c8f-90ebfda7534d service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f6967575-018c-4731-afc3-7cdc14d7f279 req-0413cb0c-b265-4fb8-8c8f-90ebfda7534d service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-f6967575-018c-4731-afc3-7cdc14d7f279 req-0413cb0c-b265-4fb8-8c8f-90ebfda7534d service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] No waiting events found dispatching network-vif-unplugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG nova.compute.manager [req-f6967575-018c-4731-afc3-7cdc14d7f279 req-0413cb0c-b265-4fb8-8c8f-90ebfda7534d service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received event network-vif-unplugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:06 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Instance destroyed successfully.
Aug 14 22:09:06 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'resources' on Instance uuid 87c08427-5779-444e-a6d0-afdc7b5c96ca {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-204822568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-204822568',id=34,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:59:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-7j7soadp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:01:38Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=87c08427-5779-444e-a6d0-afdc7b5c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "address": "fa:16:3e:9a:e6:ef", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc77aeb-ee", "ovs_interfaceid": "cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e6:ef,bridge_name='br-int',has_traffic_filtering=True,id=cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc77aeb-ee') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG os_vif [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e6:ef,bridge_name='br-int',has_traffic_filtering=True,id=cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc77aeb-ee') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfc77aeb-ee, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:09:06 user nova-compute[73144]: INFO os_vif [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e6:ef,bridge_name='br-int',has_traffic_filtering=True,id=cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc77aeb-ee')
Aug 14 22:09:06 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Deleting instance files /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca_del
Aug 14 22:09:06 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Deletion of /opt/stack/data/nova/instances/87c08427-5779-444e-a6d0-afdc7b5c96ca_del complete
Aug 14 22:09:06 user nova-compute[73144]: INFO nova.compute.manager [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 14 22:09:06 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:06 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Took 0.61 seconds to deallocate network for instance.
Aug 14 22:09:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:07 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Deleted allocations for instance 87c08427-5779-444e-a6d0-afdc7b5c96ca
Aug 14 22:09:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4eda8214-1744-4bc7-a0b1-33795887ac89 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-68fbef1f-a839-4e1a-b364-99b4bfde8347 req-fbb4677c-0733-4099-92f4-86c0b9f6622f service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received event network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68fbef1f-a839-4e1a-b364-99b4bfde8347 req-fbb4677c-0733-4099-92f4-86c0b9f6622f service nova] Acquiring lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68fbef1f-a839-4e1a-b364-99b4bfde8347 req-fbb4677c-0733-4099-92f4-86c0b9f6622f service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-68fbef1f-a839-4e1a-b364-99b4bfde8347 req-fbb4677c-0733-4099-92f4-86c0b9f6622f service nova] Lock "87c08427-5779-444e-a6d0-afdc7b5c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-68fbef1f-a839-4e1a-b364-99b4bfde8347 req-fbb4677c-0733-4099-92f4-86c0b9f6622f service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] No waiting events found dispatching network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:07 user nova-compute[73144]: WARNING nova.compute.manager [req-68fbef1f-a839-4e1a-b364-99b4bfde8347 req-fbb4677c-0733-4099-92f4-86c0b9f6622f service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received unexpected event network-vif-plugged-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d for instance with vm_state deleted and task_state None.
Aug 14 22:09:07 user nova-compute[73144]: DEBUG nova.compute.manager [req-68fbef1f-a839-4e1a-b364-99b4bfde8347 req-fbb4677c-0733-4099-92f4-86c0b9f6622f service nova] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Received event network-vif-deleted-cfc77aeb-eef3-4b2c-ab87-3cc623a6da9d {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:08 user nova-compute[73144]: INFO nova.compute.manager [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Terminating instance
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:09:08 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Creating image(s)
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Ensure instance console log exists: /opt/stack/data/nova/instances/3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Start _get_guest_xml network_info=[{"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T22:08:37Z,direct_url=<?>,disk_format='qcow2',id=fa0cffc4-813f-40ce-9ec6-8b4caec3fe2a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1150922740',owner='0f796a65843b467a9889f47789c87eed',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T22:08:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '55d82924-6231-47bc-afc9-07976bee25d9', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGJQmfTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a', 'attached_at': '', 'detached_at': '', 'volume_id': '04899616-2de3-4188-8846-c05222d42d2e', 'serial': '04899616-2de3-4188-8846-c05222d42d2e'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:09:08 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:09:08 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T22:08:37Z,direct_url=<?>,disk_format='qcow2',id=fa0cffc4-813f-40ce-9ec6-8b4caec3fe2a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1150922740',owner='0f796a65843b467a9889f47789c87eed',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T22:08:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGJQmfTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:09:08 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:09:08 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:09:08 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:09:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dafeb72-4dd6-4132-a6e9-d23f09604836]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:09:08 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc5f535-9ada-4345-ba39-1178c3dba3a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e] added
Aug 14 22:09:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadea4bd-eaf7-4007-a252-785ab5cba9d0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-4815f820-2a43-4984-a80c-4b0f42b88521 req-6d1f5025-b136-4a24-bf8a-801ebf38682d service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received event network-vif-unplugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4815f820-2a43-4984-a80c-4b0f42b88521 req-6d1f5025-b136-4a24-bf8a-801ebf38682d service nova] Acquiring lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4815f820-2a43-4984-a80c-4b0f42b88521 req-6d1f5025-b136-4a24-bf8a-801ebf38682d service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-4815f820-2a43-4984-a80c-4b0f42b88521 req-6d1f5025-b136-4a24-bf8a-801ebf38682d service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-4815f820-2a43-4984-a80c-4b0f42b88521 req-6d1f5025-b136-4a24-bf8a-801ebf38682d service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] No waiting events found dispatching network-vif-unplugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG nova.compute.manager [req-4815f820-2a43-4984-a80c-4b0f42b88521 req-6d1f5025-b136-4a24-bf8a-801ebf38682d service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received event network-vif-unplugged-5d9ebf66-4807-4973-990d-ed14ad19225e for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7b4526-80c9-4edc-9e3d-83b2bcec190f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGJQmfTD {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGJQmfTD" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f13a1-aa48-4ac4-bab1-e47e4e694492]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CGJQmfTD'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac2378-9a09-40be-9e06-10bdd5a08de1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a109f-e6d3-499e-941a-b2ae2f921ad4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:09:08 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:09:08 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:09:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:09:08 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:09:08 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:09:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc976089-763a-4b42-8c8a-86bf05e13ed5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260]
Aug 14 22:09:08 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260] successful.
Aug 14 22:09:08 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[24441048-4b05-478e-bc21-b0656b29d52a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:08 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3ea36-4021-447f-9a26-2cf530669d6d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:09:09 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:09:09 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:09:09 user nova-compute[73144]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)
Aug 14 22:09:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:09:09 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:09:09 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:09:09 user nova-compute[73144]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)
Aug 14 22:09:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f66d6db-a61f-45a9-8ec8-8079d4e5c717]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGJQmfTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:09:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Instance destroyed successfully.
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lazy-loading 'resources' on Instance uuid 0cb7079f-38f0-47a8-bf5b-6a90269384f8 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1220962728',display_name='tempest-ServersNegativeTestJSON-server-1220962728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1220962728',id=44,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:07:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17398a626e67472e81402db4abe498e1',ramdisk_id='',reservation_id='r-g074lwtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1712834715',owner_user_name='tempest-ServersNegativeTestJSON-1712834715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:07:25Z,user_data=None,user_id='43342fae8732443c990af06487af5c0b',uuid=0cb7079f-38f0-47a8-bf5b-6a90269384f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converting VIF {"id": "5d9ebf66-4807-4973-990d-ed14ad19225e", "address": "fa:16:3e:39:34:d6", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9ebf66-48", "ovs_interfaceid": "5d9ebf66-4807-4973-990d-ed14ad19225e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:34:d6,bridge_name='br-int',has_traffic_filtering=True,id=5d9ebf66-4807-4973-990d-ed14ad19225e,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9ebf66-48') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG os_vif [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:34:d6,bridge_name='br-int',has_traffic_filtering=True,id=5d9ebf66-4807-4973-990d-ed14ad19225e,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9ebf66-48') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d9ebf66-48, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:09:09 user nova-compute[73144]: INFO os_vif [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:34:d6,bridge_name='br-int',has_traffic_filtering=True,id=5d9ebf66-4807-4973-990d-ed14ad19225e,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9ebf66-48')
Aug 14 22:09:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Deleting instance files /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8_del
Aug 14 22:09:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Deletion of /opt/stack/data/nova/instances/0cb7079f-38f0-47a8-bf5b-6a90269384f8_del complete
Aug 14 22:09:09 user nova-compute[73144]: INFO nova.compute.manager [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-a35412e1-8781-4e52-91cb-36683636feb8 req-1cf012c3-7009-45c9-97e9-bf50306958a6 service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received event network-vif-deleted-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:09 user nova-compute[73144]: INFO nova.compute.manager [req-a35412e1-8781-4e52-91cb-36683636feb8 req-1cf012c3-7009-45c9-97e9-bf50306958a6 service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Neutron deleted interface 5d9ebf66-4807-4973-990d-ed14ad19225e; detaching it from the instance and deleting it from the info cache
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.network.neutron [req-a35412e1-8781-4e52-91cb-36683636feb8 req-1cf012c3-7009-45c9-97e9-bf50306958a6 service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:09 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Took 0.57 seconds to deallocate network for instance.
Aug 14 22:09:09 user nova-compute[73144]: DEBUG nova.compute.manager [req-a35412e1-8781-4e52-91cb-36683636feb8 req-1cf012c3-7009-45c9-97e9-bf50306958a6 service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Detach interface failed, port_id=5d9ebf66-4807-4973-990d-ed14ad19225e, reason: Instance 0cb7079f-38f0-47a8-bf5b-6a90269384f8 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23931336431666463', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931336431666463', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-401346553',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-401346553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-401346553',id=45,image_ref='fa0cffc4-813f-40ce-9ec6-8b4caec3fe2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTxEM83RFFXdfSEjkNw2y6QAepxENqp38bppEZUJN7eXONYeuDD0TppWkpxkcIYHWxBYLpl95FzrhTF2HxV21/peCxKB7XAd4JjI57uZJKAjTORBXrbetDIAnEJDpn7ag==',key_name='tempest-keypair-203524903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-2398r5qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-790116957',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=77d6a923-8122-48e0-8e32-e0e06e806be1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d6a923-81') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:09:10 user nova-compute[73144]:   <uuid>3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a</uuid>
Aug 14 22:09:10 user nova-compute[73144]:   <name>instance-0000002d</name>
Aug 14 22:09:10 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:09:10 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:09:10 user nova-compute[73144]:   <metadata>
Aug 14 22:09:10 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:09:10 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:09:10 user nova-compute[73144]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-401346553</nova:name>
Aug 14 22:09:10 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:09:08</nova:creationTime>
Aug 14 22:09:10 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:09:10 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:09:10 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:09:10 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:09:10 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:09:10 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:09:10 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:09:10 user nova-compute[73144]:       <nova:owner>
Aug 14 22:09:10 user nova-compute[73144]:         <nova:user uuid="52a3e93f724b43a08ee42b79c63ed4d0">tempest-TestVolumeBootPattern-790116957-project-member</nova:user>
Aug 14 22:09:10 user nova-compute[73144]:         <nova:project uuid="0f796a65843b467a9889f47789c87eed">tempest-TestVolumeBootPattern-790116957</nova:project>
Aug 14 22:09:10 user nova-compute[73144]:       </nova:owner>
Aug 14 22:09:10 user nova-compute[73144]:       <nova:root type="image" uuid="fa0cffc4-813f-40ce-9ec6-8b4caec3fe2a"/>
Aug 14 22:09:10 user nova-compute[73144]:       <nova:ports>
Aug 14 22:09:10 user nova-compute[73144]:         <nova:port uuid="77d6a923-8122-48e0-8e32-e0e06e806be1">
Aug 14 22:09:10 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 22:09:10 user nova-compute[73144]:         </nova:port>
Aug 14 22:09:10 user nova-compute[73144]:       </nova:ports>
Aug 14 22:09:10 user nova-compute[73144]:     </nova:instance>
Aug 14 22:09:10 user nova-compute[73144]:   </metadata>
Aug 14 22:09:10 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:09:10 user nova-compute[73144]:     <system>
Aug 14 22:09:10 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:09:10 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:09:10 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:09:10 user nova-compute[73144]:       <entry name="serial">3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a</entry>
Aug 14 22:09:10 user nova-compute[73144]:       <entry name="uuid">3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a</entry>
Aug 14 22:09:10 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:09:10 user nova-compute[73144]:     </system>
Aug 14 22:09:10 user nova-compute[73144]:   </sysinfo>
Aug 14 22:09:10 user nova-compute[73144]:   <os>
Aug 14 22:09:10 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:09:10 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:09:10 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:09:10 user nova-compute[73144]:   </os>
Aug 14 22:09:10 user nova-compute[73144]:   <features>
Aug 14 22:09:10 user nova-compute[73144]:     <acpi/>
Aug 14 22:09:10 user nova-compute[73144]:     <apic/>
Aug 14 22:09:10 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:09:10 user nova-compute[73144]:   </features>
Aug 14 22:09:10 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:09:10 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:09:10 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:09:10 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:09:10 user nova-compute[73144]:   </clock>
Aug 14 22:09:10 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:09:10 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:09:10 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:09:10 user nova-compute[73144]:   </cpu>
Aug 14 22:09:10 user nova-compute[73144]:   <devices>
Aug 14 22:09:10 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:09:10 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:09:10 user nova-compute[73144]:       <source dev="/dev/sde"/>
Aug 14 22:09:10 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:09:10 user nova-compute[73144]:       <serial>04899616-2de3-4188-8846-c05222d42d2e</serial>
Aug 14 22:09:10 user nova-compute[73144]:     </disk>
Aug 14 22:09:10 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:09:10 user nova-compute[73144]:       <mac address="fa:16:3e:03:f1:f0"/>
Aug 14 22:09:10 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:09:10 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:09:10 user nova-compute[73144]:       <target dev="tap77d6a923-81"/>
Aug 14 22:09:10 user nova-compute[73144]:     </interface>
Aug 14 22:09:10 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:09:10 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a/console.log" append="off"/>
Aug 14 22:09:10 user nova-compute[73144]:     </serial>
Aug 14 22:09:10 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:09:10 user nova-compute[73144]:     <video>
Aug 14 22:09:10 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:09:10 user nova-compute[73144]:     </video>
Aug 14 22:09:10 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:09:10 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:09:10 user nova-compute[73144]:     </rng>
Aug 14 22:09:10 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:09:10 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:09:10 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:09:10 user nova-compute[73144]:     </memballoon>
Aug 14 22:09:10 user nova-compute[73144]:   </devices>
Aug 14 22:09:10 user nova-compute[73144]: </domain>
Aug 14 22:09:10 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-401346553',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-401346553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-401346553',id=45,image_ref='fa0cffc4-813f-40ce-9ec6-8b4caec3fe2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTxEM83RFFXdfSEjkNw2y6QAepxENqp38bppEZUJN7eXONYeuDD0TppWkpxkcIYHWxBYLpl95FzrhTF2HxV21/peCxKB7XAd4JjI57uZJKAjTORBXrbetDIAnEJDpn7ag==',key_name='tempest-keypair-203524903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-2398r5qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-790116957',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=77d6a923-8122-48e0-8e32-e0e06e806be1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d6a923-81') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG os_vif [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=77d6a923-8122-48e0-8e32-e0e06e806be1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d6a923-81') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77d6a923-81, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77d6a923-81, col_values=(('external_ids', {'iface-id': '77d6a923-8122-48e0-8e32-e0e06e806be1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:f1:f0', 'vm-uuid': '3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:09:10 user nova-compute[73144]: INFO os_vif [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=77d6a923-8122-48e0-8e32-e0e06e806be1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d6a923-81')
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No VIF found with MAC fa:16:3e:03:f1:f0, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:10 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Deleted allocations for instance 0cb7079f-38f0-47a8-bf5b-6a90269384f8
Aug 14 22:09:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0693fc0f-3136-4a01-950d-c69f68c6cb13 tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-025ff17e-981c-4f17-8caf-4d708a4161d6 req-dae3e74a-8abc-442d-8d05-9b30da0eb3e6 service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received event network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-025ff17e-981c-4f17-8caf-4d708a4161d6 req-dae3e74a-8abc-442d-8d05-9b30da0eb3e6 service nova] Acquiring lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-025ff17e-981c-4f17-8caf-4d708a4161d6 req-dae3e74a-8abc-442d-8d05-9b30da0eb3e6 service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-025ff17e-981c-4f17-8caf-4d708a4161d6 req-dae3e74a-8abc-442d-8d05-9b30da0eb3e6 service nova] Lock "0cb7079f-38f0-47a8-bf5b-6a90269384f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:10 user nova-compute[73144]: DEBUG nova.compute.manager [req-025ff17e-981c-4f17-8caf-4d708a4161d6 req-dae3e74a-8abc-442d-8d05-9b30da0eb3e6 service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] No waiting events found dispatching network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:10 user nova-compute[73144]: WARNING nova.compute.manager [req-025ff17e-981c-4f17-8caf-4d708a4161d6 req-dae3e74a-8abc-442d-8d05-9b30da0eb3e6 service nova] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Received unexpected event network-vif-plugged-5d9ebf66-4807-4973-990d-ed14ad19225e for instance with vm_state deleted and task_state None.
Aug 14 22:09:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-8baa0a23-b678-4d4c-b741-7414f4dd45c4 req-7848ad58-e417-489c-bb71-2c004ad82541 service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8baa0a23-b678-4d4c-b741-7414f4dd45c4 req-7848ad58-e417-489c-bb71-2c004ad82541 service nova] Acquiring lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8baa0a23-b678-4d4c-b741-7414f4dd45c4 req-7848ad58-e417-489c-bb71-2c004ad82541 service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-8baa0a23-b678-4d4c-b741-7414f4dd45c4 req-7848ad58-e417-489c-bb71-2c004ad82541 service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-8baa0a23-b678-4d4c-b741-7414f4dd45c4 req-7848ad58-e417-489c-bb71-2c004ad82541 service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] No waiting events found dispatching network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:11 user nova-compute[73144]: WARNING nova.compute.manager [req-8baa0a23-b678-4d4c-b741-7414f4dd45c4 req-7848ad58-e417-489c-bb71-2c004ad82541 service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received unexpected event network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 for instance with vm_state building and task_state spawning.
Aug 14 22:09:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:12 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050953.8499155, 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:09:13 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] VM Resumed (Lifecycle Event)
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:09:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Instance spawned successfully.
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:09:13 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692050953.8522873, 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:09:13 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] VM Started (Lifecycle Event)
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:09:13 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:09:13 user nova-compute[73144]: INFO nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fbfeae2-c25d-47fa-a312-fdcb0b7aa957 req-6c1161c0-42f6-4327-bb18-07e2ba8ffacd service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fbfeae2-c25d-47fa-a312-fdcb0b7aa957 req-6c1161c0-42f6-4327-bb18-07e2ba8ffacd service nova] Acquiring lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fbfeae2-c25d-47fa-a312-fdcb0b7aa957 req-6c1161c0-42f6-4327-bb18-07e2ba8ffacd service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fbfeae2-c25d-47fa-a312-fdcb0b7aa957 req-6c1161c0-42f6-4327-bb18-07e2ba8ffacd service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:13 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fbfeae2-c25d-47fa-a312-fdcb0b7aa957 req-6c1161c0-42f6-4327-bb18-07e2ba8ffacd service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] No waiting events found dispatching network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:13 user nova-compute[73144]: WARNING nova.compute.manager [req-1fbfeae2-c25d-47fa-a312-fdcb0b7aa957 req-6c1161c0-42f6-4327-bb18-07e2ba8ffacd service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received unexpected event network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 for instance with vm_state building and task_state spawning.
Aug 14 22:09:14 user nova-compute[73144]: INFO nova.compute.manager [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Took 27.79 seconds to build instance.
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a49f294a-9e34-497c-9076-ff7afc63d695 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.896s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:16 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:09:16 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:09:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=24.96076202392578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance e5f03cb8-f350-4e69-af26-1a40519be4da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 852ffbb8-7a08-425e-b1af-78db45d7313e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:09:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:21 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050946.0429652, 87c08427-5779-444e-a6d0-afdc7b5c96ca => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:09:21 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] VM Stopped (Lifecycle Event)
Aug 14 22:09:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-276217d6-a596-4766-853f-0ac24aede131 None None] [instance: 87c08427-5779-444e-a6d0-afdc7b5c96ca] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:09:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:09:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:09:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:09:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating instance_info_cache with network_info: [{"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-e5f03cb8-f350-4e69-af26-1a40519be4da" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:09:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:09:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:23 user nova-compute[73144]: INFO nova.compute.manager [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Terminating instance
Aug 14 22:09:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050949.0827556, 0cb7079f-38f0-47a8-bf5b-6a90269384f8 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:09:24 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] VM Stopped (Lifecycle Event)
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-fb315c37-8a1d-4934-aa4a-d0ddc4f25319 None None] [instance: 0cb7079f-38f0-47a8-bf5b-6a90269384f8] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-516fe079-5bb6-4102-9f23-f5bdfae89783 req-ffd9b17a-ab9f-4521-a259-e72b2f303b1f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-vif-unplugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-516fe079-5bb6-4102-9f23-f5bdfae89783 req-ffd9b17a-ab9f-4521-a259-e72b2f303b1f service nova] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-516fe079-5bb6-4102-9f23-f5bdfae89783 req-ffd9b17a-ab9f-4521-a259-e72b2f303b1f service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-516fe079-5bb6-4102-9f23-f5bdfae89783 req-ffd9b17a-ab9f-4521-a259-e72b2f303b1f service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-516fe079-5bb6-4102-9f23-f5bdfae89783 req-ffd9b17a-ab9f-4521-a259-e72b2f303b1f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] No waiting events found dispatching network-vif-unplugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.compute.manager [req-516fe079-5bb6-4102-9f23-f5bdfae89783 req-ffd9b17a-ab9f-4521-a259-e72b2f303b1f service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-vif-unplugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:09:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Instance destroyed successfully.
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lazy-loading 'resources' on Instance uuid e5f03cb8-f350-4e69-af26-1a40519be4da {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-747128264',display_name='tempest-SnapshotDataIntegrityTests-server-747128264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-747128264',id=38,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu4u+25FUswVrnKFWU9mDFM5uCty0BQANPlm6Kndqtgy0derDqD3NUFEaPB1YMJAw44SSJkVd4cd/kKZFW6BVpaDqHq4TFznOOm3ee96JabWrGpD8FaBOa2ihzLV8RTqg==',key_name='tempest-keypair-747473871',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:01:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55a47f6f6752451688eadc99352b7101',ramdisk_id='',reservation_id='r-c32q9h0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1633399023',owner_user_name='tempest-SnapshotDataIntegrityTests-1633399023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:01:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aaa5b6401a94224ab2ac216ef372ef9',uuid=e5f03cb8-f350-4e69-af26-1a40519be4da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Converting VIF {"id": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "address": "fa:16:3e:98:44:55", "network": {"id": "ff49a0dd-cd48-4ae8-89c0-932196eed92e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247460215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a47f6f6752451688eadc99352b7101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f34fee3-11", "ovs_interfaceid": "6f34fee3-11e7-454d-b6c5-c8dbbd3b4551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:44:55,bridge_name='br-int',has_traffic_filtering=True,id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551,network=Network(ff49a0dd-cd48-4ae8-89c0-932196eed92e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f34fee3-11') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG os_vif [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:44:55,bridge_name='br-int',has_traffic_filtering=True,id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551,network=Network(ff49a0dd-cd48-4ae8-89c0-932196eed92e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f34fee3-11') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f34fee3-11, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:24 user nova-compute[73144]: INFO os_vif [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:44:55,bridge_name='br-int',has_traffic_filtering=True,id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551,network=Network(ff49a0dd-cd48-4ae8-89c0-932196eed92e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f34fee3-11')
Aug 14 22:09:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Deleting instance files /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da_del
Aug 14 22:09:24 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Deletion of /opt/stack/data/nova/instances/e5f03cb8-f350-4e69-af26-1a40519be4da_del complete
Aug 14 22:09:24 user nova-compute[73144]: INFO nova.compute.manager [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 22:09:24 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:09:24 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:09:25 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:25 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Took 0.87 seconds to deallocate network for instance.
Aug 14 22:09:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-44dbdccb-c421-4e82-a013-bc3b4e67043c req-86993adf-9919-4fe6-9980-3dd61f1a8fe3 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-vif-deleted-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:25 user nova-compute[73144]: INFO nova.compute.manager [req-44dbdccb-c421-4e82-a013-bc3b4e67043c req-86993adf-9919-4fe6-9980-3dd61f1a8fe3 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Neutron deleted interface 6f34fee3-11e7-454d-b6c5-c8dbbd3b4551; detaching it from the instance and deleting it from the info cache
Aug 14 22:09:25 user nova-compute[73144]: DEBUG nova.network.neutron [req-44dbdccb-c421-4e82-a013-bc3b4e67043c req-86993adf-9919-4fe6-9980-3dd61f1a8fe3 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:25 user nova-compute[73144]: DEBUG nova.compute.manager [req-44dbdccb-c421-4e82-a013-bc3b4e67043c req-86993adf-9919-4fe6-9980-3dd61f1a8fe3 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Detach interface failed, port_id=6f34fee3-11e7-454d-b6c5-c8dbbd3b4551, reason: Instance e5f03cb8-f350-4e69-af26-1a40519be4da could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:09:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:25 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:09:25 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:09:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:25 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Deleted allocations for instance e5f03cb8-f350-4e69-af26-1a40519be4da
Aug 14 22:09:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-bff7d2df-c4be-4d5c-9354-f932820ad68b tempest-SnapshotDataIntegrityTests-1633399023 tempest-SnapshotDataIntegrityTests-1633399023-project-member] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-29f95dba-854e-447e-8fe5-3baed5e52ded req-8ee52993-f79e-45ff-8cf7-950117c363d9 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received event network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-29f95dba-854e-447e-8fe5-3baed5e52ded req-8ee52993-f79e-45ff-8cf7-950117c363d9 service nova] Acquiring lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-29f95dba-854e-447e-8fe5-3baed5e52ded req-8ee52993-f79e-45ff-8cf7-950117c363d9 service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-29f95dba-854e-447e-8fe5-3baed5e52ded req-8ee52993-f79e-45ff-8cf7-950117c363d9 service nova] Lock "e5f03cb8-f350-4e69-af26-1a40519be4da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-29f95dba-854e-447e-8fe5-3baed5e52ded req-8ee52993-f79e-45ff-8cf7-950117c363d9 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] No waiting events found dispatching network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:26 user nova-compute[73144]: WARNING nova.compute.manager [req-29f95dba-854e-447e-8fe5-3baed5e52ded req-8ee52993-f79e-45ff-8cf7-950117c363d9 service nova] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Received unexpected event network-vif-plugged-6f34fee3-11e7-454d-b6c5-c8dbbd3b4551 for instance with vm_state deleted and task_state None.
Aug 14 22:09:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:09:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:39 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050964.5914931, e5f03cb8-f350-4e69-af26-1a40519be4da => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:09:39 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] VM Stopped (Lifecycle Event)
Aug 14 22:09:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8ba537e-7eb7-4c61-833e-071e844e063c None None] [instance: e5f03cb8-f350-4e69-af26-1a40519be4da] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:09:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:54 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:55 user nova-compute[73144]: INFO nova.compute.manager [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Terminating instance
Aug 14 22:09:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:09:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-08bce810-eba9-48b7-a7af-2591931c01c3 req-e44cb269-9e63-43a0-80e5-1e6604412030 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-08bce810-eba9-48b7-a7af-2591931c01c3 req-e44cb269-9e63-43a0-80e5-1e6604412030 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-08bce810-eba9-48b7-a7af-2591931c01c3 req-e44cb269-9e63-43a0-80e5-1e6604412030 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-08bce810-eba9-48b7-a7af-2591931c01c3 req-e44cb269-9e63-43a0-80e5-1e6604412030 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-08bce810-eba9-48b7-a7af-2591931c01c3 req-e44cb269-9e63-43a0-80e5-1e6604412030 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.compute.manager [req-08bce810-eba9-48b7-a7af-2591931c01c3 req-e44cb269-9e63-43a0-80e5-1e6604412030 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-unplugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Instance destroyed successfully.
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.objects.instance [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'resources' on Instance uuid 5229a303-2dad-45a6-b140-29a55d8d29a7 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:54:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912081673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912081673',id=26,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-zieqpqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:57:56Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=5229a303-2dad-45a6-b140-29a55d8d29a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "b3326f41-f503-40b1-a924-be55d27143a1", "address": "fa:16:3e:15:de:d2", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3326f41-f5", "ovs_interfaceid": "b3326f41-f503-40b1-a924-be55d27143a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_vif [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3326f41-f5, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:09:56 user nova-compute[73144]: INFO os_vif [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:de:d2,bridge_name='br-int',has_traffic_filtering=True,id=b3326f41-f503-40b1-a924-be55d27143a1,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3326f41-f5')
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPABoKSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:09:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f13a932-7450-4e78-bca2-a8365a6f6eac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d806c5-5650-4aa8-a403-0d814128c2ee]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:09:56 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:09:56 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:09:56 user nova-compute[73144]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)
Aug 14 22:09:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 (non-flash)
Aug 14 22:09:56 user nova-compute[73144]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:09:56 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:09:56 user nova-compute[73144]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)
Aug 14 22:09:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa178349bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d565df-ae7b-40cc-8fcf-f6aeabffbe6e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bd8560-b3d5-4870-b0be-05c588448b89]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc5207-8090-4120-a81f-2c9d712f6074]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c8f92c-5a6b-48f6-a187-002a1a8de70a]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15931e7-5e7d-4f47-b459-3d638d0d52f7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3294f1a-70cf-46fc-80cf-ea3e2cc89e57]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260]
Aug 14 22:09:56 user nova-compute[73144]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823, portal: 172.16.0.220,3260] successful.
Aug 14 22:09:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87b56623-f20c-428c-9ea2-ac2f0eeba823 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dc3a8b-f4de-4560-a6e7-80627a478bdf]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] <== disconnect_volume: return (313ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:09:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Deleting instance files /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7_del
Aug 14 22:09:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Deletion of /opt/stack/data/nova/instances/5229a303-2dad-45a6-b140-29a55d8d29a7_del complete
Aug 14 22:09:56 user nova-compute[73144]: INFO nova.compute.manager [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 14 22:09:56 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:09:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:09:57 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:57 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Took 0.65 seconds to deallocate network for instance.
Aug 14 22:09:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-86082bd3-dac4-46ef-80d0-e0914397f157 req-2c081511-d545-4571-9b53-7db0d4e5be3f service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-deleted-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:57 user nova-compute[73144]: INFO nova.compute.manager [req-86082bd3-dac4-46ef-80d0-e0914397f157 req-2c081511-d545-4571-9b53-7db0d4e5be3f service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Neutron deleted interface b3326f41-f503-40b1-a924-be55d27143a1; detaching it from the instance and deleting it from the info cache
Aug 14 22:09:57 user nova-compute[73144]: DEBUG nova.network.neutron [req-86082bd3-dac4-46ef-80d0-e0914397f157 req-2c081511-d545-4571-9b53-7db0d4e5be3f service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:09:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-86082bd3-dac4-46ef-80d0-e0914397f157 req-2c081511-d545-4571-9b53-7db0d4e5be3f service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Detach interface failed, port_id=b3326f41-f503-40b1-a924-be55d27143a1, reason: Instance 5229a303-2dad-45a6-b140-29a55d8d29a7 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:09:58 user nova-compute[73144]: INFO nova.compute.manager [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Took 0.80 seconds to detach 1 volumes for instance.
Aug 14 22:09:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-fbd37e16-5933-4290-87c3-2a5c18f48288 req-6f55948a-1aad-4b2d-94dd-f58965021855 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fbd37e16-5933-4290-87c3-2a5c18f48288 req-6f55948a-1aad-4b2d-94dd-f58965021855 service nova] Acquiring lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fbd37e16-5933-4290-87c3-2a5c18f48288 req-6f55948a-1aad-4b2d-94dd-f58965021855 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-fbd37e16-5933-4290-87c3-2a5c18f48288 req-6f55948a-1aad-4b2d-94dd-f58965021855 service nova] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-fbd37e16-5933-4290-87c3-2a5c18f48288 req-6f55948a-1aad-4b2d-94dd-f58965021855 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] No waiting events found dispatching network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:09:58 user nova-compute[73144]: WARNING nova.compute.manager [req-fbd37e16-5933-4290-87c3-2a5c18f48288 req-6f55948a-1aad-4b2d-94dd-f58965021855 service nova] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Received unexpected event network-vif-plugged-b3326f41-f503-40b1-a924-be55d27143a1 for instance with vm_state active and task_state deleting.
Aug 14 22:09:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:09:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:09:58 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Deleted allocations for instance 5229a303-2dad-45a6-b140-29a55d8d29a7
Aug 14 22:09:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-1914c2e8-73e2-450a-af03-f39eccf4eb80 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "5229a303-2dad-45a6-b140-29a55d8d29a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.899s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:10:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:10:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:10:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:10:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:09 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:11 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692050996.43304, 5229a303-2dad-45a6-b140-29a55d8d29a7 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:10:11 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] VM Stopped (Lifecycle Event)
Aug 14 22:10:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a8f038a9-b824-47ea-b622-95ab2151e0cd None None] [instance: 5229a303-2dad-45a6-b140-29a55d8d29a7] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:10:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:10:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:10:17 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=24.976581573486328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 6f7f7181-df25-4e9a-b990-251cabf0129c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 852ffbb8-7a08-425e-b1af-78db45d7313e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:10:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 22:10:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:10:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:10:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:24 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:10:24 user nova-compute[73144]: INFO nova.compute.claims [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Claim successful on node user
Aug 14 22:10:24 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:10:24 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:10:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:10:25 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Creating image(s)
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "/opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "/opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "/opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.policy [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25e50ade908b447aaeb5dac6a9bb33af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33768265e13b425c9338be4ed4242a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.172s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.183s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk 1073741824" returned: 0 in 0.048s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:25 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Successfully created port: 293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Cannot resize image /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'migration_context' on Instance uuid 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Ensure instance console log exists: /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Successfully updated port: 293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquired lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-changed-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Refreshing instance network info cache due to event network-changed-293f3220-f3d6-4d8a-a252-2791f319c059. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] Acquiring lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:10:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updating instance_info_cache with network_info: [{"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Releasing lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Instance network_info: |[{"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] Acquired lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.neutron [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Refreshing network info cache for port 293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Start _get_guest_xml network_info=[{"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:10:27 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:10:27 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2136094803',display_name='tempest-VolumesSnapshotTestJSON-instance-2136094803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2136094803',id=46,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBSMd/WLDZudgIJxadDUogxtqPeQFt0FFB5WY24yFL2tIF9kLe2j0fj2TJiDHM3v8PkDMz25oXDLaTIu1+oHA199qmAS79TQZC9oWxKy8ht4pAnV5uspnnQLuQ4vYE/sw==',key_name='tempest-keypair-1952028321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33768265e13b425c9338be4ed4242a29',ramdisk_id='',reservation_id='r-b2ldrprz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1006768833',owner_user_name='tempest-VolumesSnapshotTestJSON-1006768833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25e50ade908b447aaeb5dac6a9bb33af',uuid=37276624-7cd6-4c7d-9189-3081a532e995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converting VIF {"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:b0:25,bridge_name='br-int',has_traffic_filtering=True,id=293f3220-f3d6-4d8a-a252-2791f319c059,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap293f3220-f3') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'pci_devices' on Instance uuid 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:10:27 user nova-compute[73144]:   <uuid>37276624-7cd6-4c7d-9189-3081a532e995</uuid>
Aug 14 22:10:27 user nova-compute[73144]:   <name>instance-0000002e</name>
Aug 14 22:10:27 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:10:27 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:10:27 user nova-compute[73144]:   <metadata>
Aug 14 22:10:27 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:10:27 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:10:27 user nova-compute[73144]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2136094803</nova:name>
Aug 14 22:10:27 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:10:27</nova:creationTime>
Aug 14 22:10:27 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:10:27 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:10:27 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:10:27 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:10:27 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:10:27 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:10:27 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:10:27 user nova-compute[73144]:       <nova:owner>
Aug 14 22:10:27 user nova-compute[73144]:         <nova:user uuid="25e50ade908b447aaeb5dac6a9bb33af">tempest-VolumesSnapshotTestJSON-1006768833-project-member</nova:user>
Aug 14 22:10:27 user nova-compute[73144]:         <nova:project uuid="33768265e13b425c9338be4ed4242a29">tempest-VolumesSnapshotTestJSON-1006768833</nova:project>
Aug 14 22:10:27 user nova-compute[73144]:       </nova:owner>
Aug 14 22:10:27 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:10:27 user nova-compute[73144]:       <nova:ports>
Aug 14 22:10:27 user nova-compute[73144]:         <nova:port uuid="293f3220-f3d6-4d8a-a252-2791f319c059">
Aug 14 22:10:27 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 22:10:27 user nova-compute[73144]:         </nova:port>
Aug 14 22:10:27 user nova-compute[73144]:       </nova:ports>
Aug 14 22:10:27 user nova-compute[73144]:     </nova:instance>
Aug 14 22:10:27 user nova-compute[73144]:   </metadata>
Aug 14 22:10:27 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:10:27 user nova-compute[73144]:     <system>
Aug 14 22:10:27 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:10:27 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:10:27 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:10:27 user nova-compute[73144]:       <entry name="serial">37276624-7cd6-4c7d-9189-3081a532e995</entry>
Aug 14 22:10:27 user nova-compute[73144]:       <entry name="uuid">37276624-7cd6-4c7d-9189-3081a532e995</entry>
Aug 14 22:10:27 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:10:27 user nova-compute[73144]:     </system>
Aug 14 22:10:27 user nova-compute[73144]:   </sysinfo>
Aug 14 22:10:27 user nova-compute[73144]:   <os>
Aug 14 22:10:27 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:10:27 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:10:27 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:10:27 user nova-compute[73144]:   </os>
Aug 14 22:10:27 user nova-compute[73144]:   <features>
Aug 14 22:10:27 user nova-compute[73144]:     <acpi/>
Aug 14 22:10:27 user nova-compute[73144]:     <apic/>
Aug 14 22:10:27 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:10:27 user nova-compute[73144]:   </features>
Aug 14 22:10:27 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:10:27 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:10:27 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:10:27 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:10:27 user nova-compute[73144]:   </clock>
Aug 14 22:10:27 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:10:27 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:10:27 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:10:27 user nova-compute[73144]:   </cpu>
Aug 14 22:10:27 user nova-compute[73144]:   <devices>
Aug 14 22:10:27 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:10:27 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:10:27 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk"/>
Aug 14 22:10:27 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:10:27 user nova-compute[73144]:     </disk>
Aug 14 22:10:27 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:10:27 user nova-compute[73144]:       <mac address="fa:16:3e:10:b0:25"/>
Aug 14 22:10:27 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:10:27 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:10:27 user nova-compute[73144]:       <target dev="tap293f3220-f3"/>
Aug 14 22:10:27 user nova-compute[73144]:     </interface>
Aug 14 22:10:27 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:10:27 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/console.log" append="off"/>
Aug 14 22:10:27 user nova-compute[73144]:     </serial>
Aug 14 22:10:27 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:10:27 user nova-compute[73144]:     <video>
Aug 14 22:10:27 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:10:27 user nova-compute[73144]:     </video>
Aug 14 22:10:27 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:10:27 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:10:27 user nova-compute[73144]:     </rng>
Aug 14 22:10:27 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:10:27 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:10:27 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:10:27 user nova-compute[73144]:     </memballoon>
Aug 14 22:10:27 user nova-compute[73144]:   </devices>
Aug 14 22:10:27 user nova-compute[73144]: </domain>
Aug 14 22:10:27 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2136094803',display_name='tempest-VolumesSnapshotTestJSON-instance-2136094803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2136094803',id=46,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBSMd/WLDZudgIJxadDUogxtqPeQFt0FFB5WY24yFL2tIF9kLe2j0fj2TJiDHM3v8PkDMz25oXDLaTIu1+oHA199qmAS79TQZC9oWxKy8ht4pAnV5uspnnQLuQ4vYE/sw==',key_name='tempest-keypair-1952028321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33768265e13b425c9338be4ed4242a29',ramdisk_id='',reservation_id='r-b2ldrprz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1006768833',owner_user_name='tempest-VolumesSnapshotTestJSON-1006768833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25e50ade908b447aaeb5dac6a9bb33af',uuid=37276624-7cd6-4c7d-9189-3081a532e995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converting VIF {"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:b0:25,bridge_name='br-int',has_traffic_filtering=True,id=293f3220-f3d6-4d8a-a252-2791f319c059,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap293f3220-f3') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG os_vif [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:b0:25,bridge_name='br-int',has_traffic_filtering=True,id=293f3220-f3d6-4d8a-a252-2791f319c059,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap293f3220-f3') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap293f3220-f3, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap293f3220-f3, col_values=(('external_ids', {'iface-id': '293f3220-f3d6-4d8a-a252-2791f319c059', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:b0:25', 'vm-uuid': '37276624-7cd6-4c7d-9189-3081a532e995'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:27 user nova-compute[73144]: INFO os_vif [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:b0:25,bridge_name='br-int',has_traffic_filtering=True,id=293f3220-f3d6-4d8a-a252-2791f319c059,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap293f3220-f3')
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No VIF found with MAC fa:16:3e:10:b0:25, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.neutron [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updated VIF entry in instance network info cache for port 293f3220-f3d6-4d8a-a252-2791f319c059. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG nova.network.neutron [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updating instance_info_cache with network_info: [{"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f228d330-03d6-4c8f-bf56-e46a59cbe574 req-220b8e5d-409c-49f6-aa10-7eccff7f4e70 service nova] Releasing lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-3c099bbd-f26d-4468-8dc4-5aeed4ab4b21 req-0c2a2c82-9963-4a17-83f4-aec2f651ba25 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3c099bbd-f26d-4468-8dc4-5aeed4ab4b21 req-0c2a2c82-9963-4a17-83f4-aec2f651ba25 service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3c099bbd-f26d-4468-8dc4-5aeed4ab4b21 req-0c2a2c82-9963-4a17-83f4-aec2f651ba25 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3c099bbd-f26d-4468-8dc4-5aeed4ab4b21 req-0c2a2c82-9963-4a17-83f4-aec2f651ba25 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-3c099bbd-f26d-4468-8dc4-5aeed4ab4b21 req-0c2a2c82-9963-4a17-83f4-aec2f651ba25 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:10:28 user nova-compute[73144]: WARNING nova.compute.manager [req-3c099bbd-f26d-4468-8dc4-5aeed4ab4b21 req-0c2a2c82-9963-4a17-83f4-aec2f651ba25 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received unexpected event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with vm_state building and task_state spawning.
Aug 14 22:10:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051030.8795457, 37276624-7cd6-4c7d-9189-3081a532e995 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:10:30 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] VM Resumed (Lifecycle Event)
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:10:30 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Instance spawned successfully.
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:10:30 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051030.8828197, 37276624-7cd6-4c7d-9189-3081a532e995 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:10:30 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] VM Started (Lifecycle Event)
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:10:30 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:10:30 user nova-compute[73144]: INFO nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 14 22:10:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:10:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-1352b071-2a5c-40c4-bcb9-70c88e0ea39b req-5a42a6a5-ba89-4e10-a2e6-197562eb3eca service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1352b071-2a5c-40c4-bcb9-70c88e0ea39b req-5a42a6a5-ba89-4e10-a2e6-197562eb3eca service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1352b071-2a5c-40c4-bcb9-70c88e0ea39b req-5a42a6a5-ba89-4e10-a2e6-197562eb3eca service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1352b071-2a5c-40c4-bcb9-70c88e0ea39b req-5a42a6a5-ba89-4e10-a2e6-197562eb3eca service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-1352b071-2a5c-40c4-bcb9-70c88e0ea39b req-5a42a6a5-ba89-4e10-a2e6-197562eb3eca service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:10:31 user nova-compute[73144]: WARNING nova.compute.manager [req-1352b071-2a5c-40c4-bcb9-70c88e0ea39b req-5a42a6a5-ba89-4e10-a2e6-197562eb3eca service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received unexpected event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with vm_state building and task_state spawning.
Aug 14 22:10:31 user nova-compute[73144]: INFO nova.compute.manager [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Took 6.38 seconds to build instance.
Aug 14 22:10:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ae567b86-70f1-448e-ab47-c485b9ac3ba7 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.490s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-changed-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Refreshing instance network info cache due to event network-changed-77d6a923-8122-48e0-8e32-e0e06e806be1. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:10:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] Acquiring lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:10:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] Acquired lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:10:37 user nova-compute[73144]: DEBUG nova.network.neutron [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Refreshing network info cache for port 77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:38 user nova-compute[73144]: INFO nova.compute.manager [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Terminating instance
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Updated VIF entry in instance network info cache for port 77d6a923-8122-48e0-8e32-e0e06e806be1. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Updating instance_info_cache with network_info: [{"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-657edd0a-43c3-4c1a-8fbc-93770a627da3 req-e3e97c45-d848-47bd-923c-79781afe8ffa service nova] Releasing lock "refresh_cache-3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-980d4f58-2fd2-4d7f-b5e7-1e76ab1e0371 req-cf6e4021-85ec-4a58-8d6c-1584028f274e service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-vif-unplugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-980d4f58-2fd2-4d7f-b5e7-1e76ab1e0371 req-cf6e4021-85ec-4a58-8d6c-1584028f274e service nova] Acquiring lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-980d4f58-2fd2-4d7f-b5e7-1e76ab1e0371 req-cf6e4021-85ec-4a58-8d6c-1584028f274e service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-980d4f58-2fd2-4d7f-b5e7-1e76ab1e0371 req-cf6e4021-85ec-4a58-8d6c-1584028f274e service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-980d4f58-2fd2-4d7f-b5e7-1e76ab1e0371 req-cf6e4021-85ec-4a58-8d6c-1584028f274e service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] No waiting events found dispatching network-vif-unplugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-980d4f58-2fd2-4d7f-b5e7-1e76ab1e0371 req-cf6e4021-85ec-4a58-8d6c-1584028f274e service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-vif-unplugged-77d6a923-8122-48e0-8e32-e0e06e806be1 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:38 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Instance destroyed successfully.
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.objects.instance [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'resources' on Instance uuid 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-401346553',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-401346553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-401346553',id=45,image_ref='fa0cffc4-813f-40ce-9ec6-8b4caec3fe2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTxEM83RFFXdfSEjkNw2y6QAepxENqp38bppEZUJN7eXONYeuDD0TppWkpxkcIYHWxBYLpl95FzrhTF2HxV21/peCxKB7XAd4JjI57uZJKAjTORBXrbetDIAnEJDpn7ag==',key_name='tempest-keypair-203524903',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:09:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-2398r5qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-790116957',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "77d6a923-8122-48e0-8e32-e0e06e806be1", "address": "fa:16:3e:03:f1:f0", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d6a923-81", "ovs_interfaceid": "77d6a923-8122-48e0-8e32-e0e06e806be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=77d6a923-8122-48e0-8e32-e0e06e806be1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d6a923-81') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_vif [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=77d6a923-8122-48e0-8e32-e0e06e806be1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d6a923-81') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77d6a923-81, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:10:38 user nova-compute[73144]: INFO os_vif [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=77d6a923-8122-48e0-8e32-e0e06e806be1,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d6a923-81')
Aug 14 22:10:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGJQmfTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:10:38 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5291ef-a85f-436f-a1ac-0a35f90ff238]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce33788-ae0f-4a3b-a05d-0b48387cbf96]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:10:38 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:10:38 user nova-compute[73144]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)
Aug 14 22:10:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:10:38 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:10:38 user nova-compute[73144]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e (non-flash)
Aug 14 22:10:38 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa178349bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:10:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6438e588-b448-4e3b-ae69-8f59d857de41]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f04fb-2a67-4a8d-951b-2d0ac782d819]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bab228-5578-4a76-9f8e-d7eb2f88c34a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca84998-1470-4433-afb9-488b09d392db]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc3a53f35-913d1fdc6dafad2a', '/dev/disk/by-id/scsi-23931336431666463', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c3a53f35') {{(pid=84572) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10c3671-73a1-4752-8916-dbdfe91eaa55]: (4, None) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7179c2b9-2fbb-480c-b564-30381b188359]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[24278b04-505e-4d31-a385-6c3ffba54e66]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260]
Aug 14 22:10:39 user nova-compute[73144]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e, portal: 172.16.0.220,3260] successful.
Aug 14 22:10:39 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04899616-2de3-4188-8846-c05222d42d2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9759c401-8cc5-476d-98f8-54c2c484f221]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== disconnect_volume: return (433ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:10:39 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Deleting instance files /opt/stack/data/nova/instances/3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a_del
Aug 14 22:10:39 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Deletion of /opt/stack/data/nova/instances/3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a_del complete
Aug 14 22:10:39 user nova-compute[73144]: INFO nova.compute.manager [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 14 22:10:39 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:10:39 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:10:40 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:40 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Took 0.96 seconds to deallocate network for instance.
Aug 14 22:10:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fd8af4a-ea5c-4b99-8d57-624a20c8469d req-ae3ae379-6322-4b6c-90dc-e4efa55b0137 service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fd8af4a-ea5c-4b99-8d57-624a20c8469d req-ae3ae379-6322-4b6c-90dc-e4efa55b0137 service nova] Acquiring lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fd8af4a-ea5c-4b99-8d57-624a20c8469d req-ae3ae379-6322-4b6c-90dc-e4efa55b0137 service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1fd8af4a-ea5c-4b99-8d57-624a20c8469d req-ae3ae379-6322-4b6c-90dc-e4efa55b0137 service nova] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fd8af4a-ea5c-4b99-8d57-624a20c8469d req-ae3ae379-6322-4b6c-90dc-e4efa55b0137 service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] No waiting events found dispatching network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:10:40 user nova-compute[73144]: WARNING nova.compute.manager [req-1fd8af4a-ea5c-4b99-8d57-624a20c8469d req-ae3ae379-6322-4b6c-90dc-e4efa55b0137 service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received unexpected event network-vif-plugged-77d6a923-8122-48e0-8e32-e0e06e806be1 for instance with vm_state active and task_state deleting.
Aug 14 22:10:40 user nova-compute[73144]: DEBUG nova.compute.manager [req-1fd8af4a-ea5c-4b99-8d57-624a20c8469d req-ae3ae379-6322-4b6c-90dc-e4efa55b0137 service nova] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Received event network-vif-deleted-77d6a923-8122-48e0-8e32-e0e06e806be1 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:41 user nova-compute[73144]: INFO nova.compute.manager [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Took 0.79 seconds to detach 1 volumes for instance.
Aug 14 22:10:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Deleting volume: 04899616-2de3-4188-8846-c05222d42d2e {{(pid=73144) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 22:10:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:41 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:10:41 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:10:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:41 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Deleted allocations for instance 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a
Aug 14 22:10:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5adb0b85-1c79-46c5-aac5-33fd272196d5 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.565s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:46 user nova-compute[73144]: INFO nova.compute.manager [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Terminating instance
Aug 14 22:10:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-7ddd4aa6-0027-478e-b987-f7aeb13462b8 req-49d9bcae-3d4d-4113-9add-27f23cfe1332 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received event network-vif-unplugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7ddd4aa6-0027-478e-b987-f7aeb13462b8 req-49d9bcae-3d4d-4113-9add-27f23cfe1332 service nova] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7ddd4aa6-0027-478e-b987-f7aeb13462b8 req-49d9bcae-3d4d-4113-9add-27f23cfe1332 service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7ddd4aa6-0027-478e-b987-f7aeb13462b8 req-49d9bcae-3d4d-4113-9add-27f23cfe1332 service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-7ddd4aa6-0027-478e-b987-f7aeb13462b8 req-49d9bcae-3d4d-4113-9add-27f23cfe1332 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] No waiting events found dispatching network-vif-unplugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:10:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-7ddd4aa6-0027-478e-b987-f7aeb13462b8 req-49d9bcae-3d4d-4113-9add-27f23cfe1332 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received event network-vif-unplugged-1fc0de81-5521-4be1-b1bc-d28db799f045 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Instance destroyed successfully.
Aug 14 22:10:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lazy-loading 'resources' on Instance uuid 6f7f7181-df25-4e9a-b990-251cabf0129c {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:50:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-577581934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-577581934',id=17,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:50:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59e45dfdc13e486e950f6bc8595bb8fa',ramdisk_id='',reservation_id='r-n93vdwa3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-847208830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:52:13Z,user_data=None,user_id='cfe8b1fc0405438c99d3edd956e103a4',uuid=6f7f7181-df25-4e9a-b990-251cabf0129c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converting VIF {"id": "1fc0de81-5521-4be1-b1bc-d28db799f045", "address": "fa:16:3e:a4:41:fd", "network": {"id": "5667ac1f-192d-4c3d-8dea-e603242da962", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-987099197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59e45dfdc13e486e950f6bc8595bb8fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc0de81-55", "ovs_interfaceid": "1fc0de81-5521-4be1-b1bc-d28db799f045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:41:fd,bridge_name='br-int',has_traffic_filtering=True,id=1fc0de81-5521-4be1-b1bc-d28db799f045,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc0de81-55') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG os_vif [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:41:fd,bridge_name='br-int',has_traffic_filtering=True,id=1fc0de81-5521-4be1-b1bc-d28db799f045,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc0de81-55') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fc0de81-55, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:47 user nova-compute[73144]: INFO os_vif [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:41:fd,bridge_name='br-int',has_traffic_filtering=True,id=1fc0de81-5521-4be1-b1bc-d28db799f045,network=Network(5667ac1f-192d-4c3d-8dea-e603242da962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc0de81-55')
Aug 14 22:10:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Deleting instance files /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c_del
Aug 14 22:10:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Deletion of /opt/stack/data/nova/instances/6f7f7181-df25-4e9a-b990-251cabf0129c_del complete
Aug 14 22:10:47 user nova-compute[73144]: INFO nova.compute.manager [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 14 22:10:47 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:10:47 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:10:48 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:48 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Took 0.99 seconds to deallocate network for instance.
Aug 14 22:10:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-b39583f8-8a7c-4bd2-ac07-ffcb85e4d775 req-d2fef1fc-8a92-49cb-af6a-d0a24666ba1c service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received event network-vif-deleted-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:48 user nova-compute[73144]: INFO nova.compute.manager [req-b39583f8-8a7c-4bd2-ac07-ffcb85e4d775 req-d2fef1fc-8a92-49cb-af6a-d0a24666ba1c service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Neutron deleted interface 1fc0de81-5521-4be1-b1bc-d28db799f045; detaching it from the instance and deleting it from the info cache
Aug 14 22:10:48 user nova-compute[73144]: DEBUG nova.network.neutron [req-b39583f8-8a7c-4bd2-ac07-ffcb85e4d775 req-d2fef1fc-8a92-49cb-af6a-d0a24666ba1c service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-b39583f8-8a7c-4bd2-ac07-ffcb85e4d775 req-d2fef1fc-8a92-49cb-af6a-d0a24666ba1c service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Detach interface failed, port_id=1fc0de81-5521-4be1-b1bc-d28db799f045, reason: Instance 6f7f7181-df25-4e9a-b990-251cabf0129c could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:10:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:48 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:10:48 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:10:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:48 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Deleted allocations for instance 6f7f7181-df25-4e9a-b990-251cabf0129c
Aug 14 22:10:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a0c3eff4-8ab7-4991-95c5-b4c444af1fe2 tempest-ServerBootFromVolumeStableRescueTest-847208830 tempest-ServerBootFromVolumeStableRescueTest-847208830-project-member] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing instance network info cache due to event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] Acquiring lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] Acquired lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received event network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] Acquiring lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] Lock "6f7f7181-df25-4e9a-b990-251cabf0129c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] No waiting events found dispatching network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:10:49 user nova-compute[73144]: WARNING nova.compute.manager [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Received unexpected event network-vif-plugged-1fc0de81-5521-4be1-b1bc-d28db799f045 for instance with vm_state deleted and task_state None.
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing instance network info cache due to event network-changed-138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] Acquiring lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:10:49 user nova-compute[73144]: INFO nova.compute.manager [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Detaching volume 2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b
Aug 14 22:10:49 user nova-compute[73144]: INFO nova.virt.block_device [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Attempting to driver detach volume 2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b from mountpoint /dev/vdb
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Attempting to detach device vdb from instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:10:49 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:10:49 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:10:49 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:10:49 user nova-compute[73144]:   <serial>2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b</serial>
Aug 14 22:10:49 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:10:49 user nova-compute[73144]: </disk>
Aug 14 22:10:49 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:10:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully detached device vdb from instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 from the persistent domain config.
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:10:49 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:10:49 user nova-compute[73144]:   <source dev="/dev/sdd"/>
Aug 14 22:10:49 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:10:49 user nova-compute[73144]:   <serial>2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b</serial>
Aug 14 22:10:49 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:10:49 user nova-compute[73144]: </disk>
Aug 14 22:10:49 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updated VIF entry in instance network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b402247e-984e-4295-b2bd-a9983d000a49 req-1da31591-8214-4cdf-9479-ba67db4e2088 service nova] Releasing lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] Acquired lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Refreshing network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692051049.885143, cdec4545-a332-4ea3-ba7e-0af93fac0ff3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:10:49 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully detached device vdb from instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 from the live domain config.
Aug 14 22:10:49 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjMsacJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:10:49 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba5e8ea-8851-4a3c-9261-b0a5d5a4b234]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fac21a3-9b5a-4636-ba89-7adfbad20895]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:10:49 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:10:49 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:10:49 user nova-compute[73144]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b (non-flash)
Aug 14 22:10:49 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17865cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2847c74-fab2-4072-92cb-1f0b428816e1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:49 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c91b3bc-2bd6-4ae9-a81b-ec3681f994bb]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f1e67-b294-4004-80a5-6c4681840a7f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[782b751f-e258-4394-ad52-26e84f4199bb]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[038522d0-b849-4c47-9be0-337f97087998]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updated VIF entry in instance network info cache for port 138a9dbe-1881-4f2b-8df1-ecf97565f90c. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [{"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-7edcaa35-f7e7-4d9f-b101-606d2d151a24 req-5dac2096-42c1-4537-869e-860187f8acf4 service nova] Releasing lock "refresh_cache-cdec4545-a332-4ea3-ba7e-0af93fac0ff3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c0562-9d0d-44f4-b839-2774d5afac2f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260]
Aug 14 22:10:50 user nova-compute[73144]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b, portal: 172.16.0.220,3260] successful.
Aug 14 22:10:50 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f749d8d-f631-4d8c-82ca-2cb12fbd3d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c161c64-1e53-4783-841f-c2eceafdfbc4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] <== disconnect_volume: return (286ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:10:50 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'flavor' on Instance uuid cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:10:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e57a94af-6952-4112-a027-fb4e7f488519 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:10:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:53 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051038.866174, 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:10:53 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] VM Stopped (Lifecycle Event)
Aug 14 22:10:53 user nova-compute[73144]: DEBUG nova.compute.manager [None req-0996ca8c-ffa7-40b1-a761-ae8dce750727 None None] [instance: 3c8e1cdd-a5bf-47ce-8d33-5c2bac9c5e8a] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:10:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:10:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:02 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051047.2414942, 6f7f7181-df25-4e9a-b990-251cabf0129c => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:11:02 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] VM Stopped (Lifecycle Event)
Aug 14 22:11:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4e64d4fc-6501-4bc7-8584-41f131a47f81 None None] [instance: 6f7f7181-df25-4e9a-b990-251cabf0129c] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:11:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:11:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:11:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:11:14 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:18 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:11:18 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8271MB free_disk=25.06993865966797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 852ffbb8-7a08-425e-b1af-78db45d7313e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37276624-7cd6-4c7d-9189-3081a532e995 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:11:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 22:11:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 22:11:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:11:22 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:11:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updating instance_info_cache with network_info: [{"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:11:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:11:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:11:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:25 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 852ffbb8-7a08-425e-b1af-78db45d7313e {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Triggering sync for uuid 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "37276624-7cd6-4c7d-9189-3081a532e995" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "37276624-7cd6-4c7d-9189-3081a532e995" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:33 user nova-compute[73144]: INFO nova.compute.manager [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Terminating instance
Aug 14 22:11:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-24057641-e1ba-46a6-847e-f4f9a4ce31e2 req-d7df6b4d-7845-4b77-9ed5-77a2680408d5 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-vif-unplugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-24057641-e1ba-46a6-847e-f4f9a4ce31e2 req-d7df6b4d-7845-4b77-9ed5-77a2680408d5 service nova] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-24057641-e1ba-46a6-847e-f4f9a4ce31e2 req-d7df6b4d-7845-4b77-9ed5-77a2680408d5 service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-24057641-e1ba-46a6-847e-f4f9a4ce31e2 req-d7df6b4d-7845-4b77-9ed5-77a2680408d5 service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-24057641-e1ba-46a6-847e-f4f9a4ce31e2 req-d7df6b4d-7845-4b77-9ed5-77a2680408d5 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] No waiting events found dispatching network-vif-unplugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-24057641-e1ba-46a6-847e-f4f9a4ce31e2 req-d7df6b4d-7845-4b77-9ed5-77a2680408d5 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-vif-unplugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:11:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Instance destroyed successfully.
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'resources' on Instance uuid 852ffbb8-7a08-425e-b1af-78db45d7313e {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2101394125',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2101394125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2101394125',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiVliqQL7MwUfoAw0B3OVBZPYa0NKnhwD6PYyMkqYAbtLNs9DD0OD1F67SJm8GCUxWffIeRB6EP6lcP+Bkh4/CK40TWF1IfqsYDrXSONEubzl5R39fGNRMYyS4xpAKiew==',key_name='tempest-keypair-1952391104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:06:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-q73tclir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=852ffbb8-7a08-425e-b1af-78db45d7313e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "address": "fa:16:3e:8e:0b:7a", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8845dd0a-60", "ovs_interfaceid": "8845dd0a-60ec-47c8-ab1a-70b7efd35560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:0b:7a,bridge_name='br-int',has_traffic_filtering=True,id=8845dd0a-60ec-47c8-ab1a-70b7efd35560,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dd0a-60') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_vif [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:0b:7a,bridge_name='br-int',has_traffic_filtering=True,id=8845dd0a-60ec-47c8-ab1a-70b7efd35560,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dd0a-60') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8845dd0a-60, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:34 user nova-compute[73144]: INFO os_vif [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:0b:7a,bridge_name='br-int',has_traffic_filtering=True,id=8845dd0a-60ec-47c8-ab1a-70b7efd35560,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8845dd0a-60')
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzGCMOKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:11:34 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[352da824-57cc-40a4-9478-44681ac0601c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eee48a0-de72-4eda-94e5-370f0166ad20]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:11:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 (non-flash)
Aug 14 22:11:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa178365fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb58d1b-fc11-4154-91e8-c3e4ae2f26f8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c00efd-e348-4076-8a07-058faa295213]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f875e0-c0ae-4bb5-a41a-bf19237175e5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a4dba0-e8ef-4753-b203-d0b61ac11410]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO97292484-a2f319de383a3c7a', '/dev/disk/by-id/scsi-26132663331396465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_97292484') {{(pid=84572) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8280fbb3-3b49-4ba9-95a4-868ffc7081e0]: (4, None) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6103fc18-e76a-485d-8b1a-5fc821f1f589]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddcbf0f-f1ff-4b9c-8042-fddbde1b640e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260]
Aug 14 22:11:34 user nova-compute[73144]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236, portal: 172.16.0.220,3260] successful.
Aug 14 22:11:34 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08419ad9-939f-4eb5-bd2f-959f3d5b6236 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84a3eb-bee3-4aa2-83b8-335cc1c3001a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== disconnect_volume: return (290ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:11:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Deleting instance files /opt/stack/data/nova/instances/852ffbb8-7a08-425e-b1af-78db45d7313e_del
Aug 14 22:11:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Deletion of /opt/stack/data/nova/instances/852ffbb8-7a08-425e-b1af-78db45d7313e_del complete
Aug 14 22:11:34 user nova-compute[73144]: INFO nova.compute.manager [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 14 22:11:34 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:11:34 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:11:35 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:11:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-75e40ab6-f9c9-4d24-9aae-615fd67b349b req-179cfaaf-6f7f-4631-90a7-bee95212533d service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-vif-deleted-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:11:35 user nova-compute[73144]: INFO nova.compute.manager [req-75e40ab6-f9c9-4d24-9aae-615fd67b349b req-179cfaaf-6f7f-4631-90a7-bee95212533d service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Neutron deleted interface 8845dd0a-60ec-47c8-ab1a-70b7efd35560; detaching it from the instance and deleting it from the info cache
Aug 14 22:11:35 user nova-compute[73144]: DEBUG nova.network.neutron [req-75e40ab6-f9c9-4d24-9aae-615fd67b349b req-179cfaaf-6f7f-4631-90a7-bee95212533d service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:11:35 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Took 0.73 seconds to deallocate network for instance.
Aug 14 22:11:35 user nova-compute[73144]: DEBUG nova.compute.manager [req-75e40ab6-f9c9-4d24-9aae-615fd67b349b req-179cfaaf-6f7f-4631-90a7-bee95212533d service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Detach interface failed, port_id=8845dd0a-60ec-47c8-ab1a-70b7efd35560, reason: Instance 852ffbb8-7a08-425e-b1af-78db45d7313e could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-f0955784-19e9-4474-80a6-5ce498747df3 req-9867069c-5731-4811-a7fb-0e784cfb9782 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received event network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f0955784-19e9-4474-80a6-5ce498747df3 req-9867069c-5731-4811-a7fb-0e784cfb9782 service nova] Acquiring lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f0955784-19e9-4474-80a6-5ce498747df3 req-9867069c-5731-4811-a7fb-0e784cfb9782 service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f0955784-19e9-4474-80a6-5ce498747df3 req-9867069c-5731-4811-a7fb-0e784cfb9782 service nova] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG nova.compute.manager [req-f0955784-19e9-4474-80a6-5ce498747df3 req-9867069c-5731-4811-a7fb-0e784cfb9782 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] No waiting events found dispatching network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:11:36 user nova-compute[73144]: WARNING nova.compute.manager [req-f0955784-19e9-4474-80a6-5ce498747df3 req-9867069c-5731-4811-a7fb-0e784cfb9782 service nova] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Received unexpected event network-vif-plugged-8845dd0a-60ec-47c8-ab1a-70b7efd35560 for instance with vm_state active and task_state deleting.
Aug 14 22:11:36 user nova-compute[73144]: INFO nova.compute.manager [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 22:11:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Deleting volume: 08419ad9-939f-4eb5-bd2f-959f3d5b6236 {{(pid=73144) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:11:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:36 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Deleted allocations for instance 852ffbb8-7a08-425e-b1af-78db45d7313e
Aug 14 22:11:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d6cfe893-2fb6-4e2a-965e-9d88112d90fc tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "852ffbb8-7a08-425e-b1af-78db45d7313e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.022s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:46 user nova-compute[73144]: INFO nova.compute.manager [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Terminating instance
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-26b27a9d-95d5-4bea-bae1-7583b00f600d req-7d414e67-15d7-44f5-8233-a9ab64961eb2 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-unplugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-26b27a9d-95d5-4bea-bae1-7583b00f600d req-7d414e67-15d7-44f5-8233-a9ab64961eb2 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-26b27a9d-95d5-4bea-bae1-7583b00f600d req-7d414e67-15d7-44f5-8233-a9ab64961eb2 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-26b27a9d-95d5-4bea-bae1-7583b00f600d req-7d414e67-15d7-44f5-8233-a9ab64961eb2 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-26b27a9d-95d5-4bea-bae1-7583b00f600d req-7d414e67-15d7-44f5-8233-a9ab64961eb2 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-unplugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.compute.manager [req-26b27a9d-95d5-4bea-bae1-7583b00f600d req-7d414e67-15d7-44f5-8233-a9ab64961eb2 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-unplugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:11:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Instance destroyed successfully.
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.objects.instance [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lazy-loading 'resources' on Instance uuid cdec4545-a332-4ea3-ba7e-0af93fac0ff3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1859676118',display_name='tempest-TestMinimumBasicScenario-server-1859676118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1859676118',id=42,image_ref='77d76055-e83c-4233-8c59-ade63177ab2d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh/2uF8toKdrRU4M9Er/ZYScuuazfUOKfRdZkjXybwCrVmP3q2yFjyvRm1PQXwxDM3V/hF2KzQxk6M+8Os/QFdmRM0bxdRDa3hvEnEDXLZkJ1Lvx27DKr6b9QXR244DHQ==',key_name='tempest-TestMinimumBasicScenario-1262022519',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:06:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d1319de1ca444198f3edddf26ce07b1',ramdisk_id='',reservation_id='r-xx4cd4c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77d76055-e83c-4233-8c59-ade63177ab2d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1966855885',owner_user_name='tempest-TestMinimumBasicScenario-1966855885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:09:04Z,user_data=None,user_id='f5b646bc914e419e987ebada26905446',uuid=cdec4545-a332-4ea3-ba7e-0af93fac0ff3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converting VIF {"id": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "address": "fa:16:3e:e2:e1:a1", "network": {"id": "a9612138-6fd0-4238-bfd6-c27cf29c77a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2041156371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1319de1ca444198f3edddf26ce07b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138a9dbe-18", "ovs_interfaceid": "138a9dbe-1881-4f2b-8df1-ecf97565f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e1:a1,bridge_name='br-int',has_traffic_filtering=True,id=138a9dbe-1881-4f2b-8df1-ecf97565f90c,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a9dbe-18') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG os_vif [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e1:a1,bridge_name='br-int',has_traffic_filtering=True,id=138a9dbe-1881-4f2b-8df1-ecf97565f90c,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a9dbe-18') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap138a9dbe-18, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:11:46 user nova-compute[73144]: INFO os_vif [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e1:a1,bridge_name='br-int',has_traffic_filtering=True,id=138a9dbe-1881-4f2b-8df1-ecf97565f90c,network=Network(a9612138-6fd0-4238-bfd6-c27cf29c77a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138a9dbe-18')
Aug 14 22:11:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Deleting instance files /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3_del
Aug 14 22:11:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Deletion of /opt/stack/data/nova/instances/cdec4545-a332-4ea3-ba7e-0af93fac0ff3_del complete
Aug 14 22:11:46 user nova-compute[73144]: INFO nova.compute.manager [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 14 22:11:46 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:11:46 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:11:47 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:11:47 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Took 0.49 seconds to deallocate network for instance.
Aug 14 22:11:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-ddb58ab0-5592-44ff-855b-4ccd0e319b96 req-510ba3a9-c0c3-40ed-b786-3705f152de53 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-deleted-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:11:47 user nova-compute[73144]: INFO nova.compute.manager [req-ddb58ab0-5592-44ff-855b-4ccd0e319b96 req-510ba3a9-c0c3-40ed-b786-3705f152de53 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Neutron deleted interface 138a9dbe-1881-4f2b-8df1-ecf97565f90c; detaching it from the instance and deleting it from the info cache
Aug 14 22:11:47 user nova-compute[73144]: DEBUG nova.network.neutron [req-ddb58ab0-5592-44ff-855b-4ccd0e319b96 req-510ba3a9-c0c3-40ed-b786-3705f152de53 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:11:47 user nova-compute[73144]: DEBUG nova.compute.manager [req-ddb58ab0-5592-44ff-855b-4ccd0e319b96 req-510ba3a9-c0c3-40ed-b786-3705f152de53 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Detach interface failed, port_id=138a9dbe-1881-4f2b-8df1-ecf97565f90c, reason: Instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:11:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:47 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:11:47 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:11:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:47 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Deleted allocations for instance cdec4545-a332-4ea3-ba7e-0af93fac0ff3
Aug 14 22:11:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-389b748c-1bf2-4eae-b7b4-403f06df56b6 tempest-TestMinimumBasicScenario-1966855885 tempest-TestMinimumBasicScenario-1966855885-project-member] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.668s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-c600bdc6-9b4e-4788-921f-6df2eac02b17 req-c700de8b-b120-4836-91f2-d3c066b1a619 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:11:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c600bdc6-9b4e-4788-921f-6df2eac02b17 req-c700de8b-b120-4836-91f2-d3c066b1a619 service nova] Acquiring lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:11:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c600bdc6-9b4e-4788-921f-6df2eac02b17 req-c700de8b-b120-4836-91f2-d3c066b1a619 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:11:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c600bdc6-9b4e-4788-921f-6df2eac02b17 req-c700de8b-b120-4836-91f2-d3c066b1a619 service nova] Lock "cdec4545-a332-4ea3-ba7e-0af93fac0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:11:48 user nova-compute[73144]: DEBUG nova.compute.manager [req-c600bdc6-9b4e-4788-921f-6df2eac02b17 req-c700de8b-b120-4836-91f2-d3c066b1a619 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] No waiting events found dispatching network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:11:48 user nova-compute[73144]: WARNING nova.compute.manager [req-c600bdc6-9b4e-4788-921f-6df2eac02b17 req-c700de8b-b120-4836-91f2-d3c066b1a619 service nova] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Received unexpected event network-vif-plugged-138a9dbe-1881-4f2b-8df1-ecf97565f90c for instance with vm_state deleted and task_state None.
Aug 14 22:11:49 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051094.5799384, 852ffbb8-7a08-425e-b1af-78db45d7313e => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:11:49 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] VM Stopped (Lifecycle Event)
Aug 14 22:11:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-c653d840-3403-49a9-90df-7584fd27f4b0 None None] [instance: 852ffbb8-7a08-425e-b1af-78db45d7313e] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:11:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:11:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:11:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:11:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:11:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:11:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:01 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051106.8864312, cdec4545-a332-4ea3-ba7e-0af93fac0ff3 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:12:01 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] VM Stopped (Lifecycle Event)
Aug 14 22:12:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-5c9e26c7-9902-4452-9971-841f0fbfc1ec None None] [instance: cdec4545-a332-4ea3-ba7e-0af93fac0ff3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:12:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:12:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:12:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:12:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:12:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:13 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:12:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-changed-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:12:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Refreshing instance network info cache due to event network-changed-293f3220-f3d6-4d8a-a252-2791f319c059. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:12:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] Acquiring lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:12:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] Acquired lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:12:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Refreshing network info cache for port 293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'flavor' on Instance uuid 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:12:16 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Ignoring supplied device name: /dev/vdb
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:16 user nova-compute[73144]: INFO nova.compute.manager [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Attaching volume 62e9856c-3371-4918-841d-4c39916bed3b to /dev/vdb
Aug 14 22:12:16 user nova-compute[73144]: DEBUG os_brick.utils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b289e1-9bb4-4f39-b7bb-0a47839ed2aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updated VIF entry in instance network info cache for port 293f3220-f3d6-4d8a-a252-2791f319c059. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updating instance_info_cache with network_info: [{"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45481a8-3cec-4566-a3a2-8098a9fed7af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1c346221-0181-47e2-a4f3-a0eb7eba1fce req-b72f68c3-8318-46c4-9fa0-5a1e2370c4e2 service nova] Releasing lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aed963-143d-43b5-bc2b-17d926edf093]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f3e18-299c-4573-8fd4-487c9f2b48b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:12:16 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ed1b0b-a8ab-44bc-856c-c78b5e58d39d]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG os_brick.utils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updating existing volume attachment record: 34dd0e14-7bab-4d5f-b963-15a37d72315b {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:17 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:18 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:12:18 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:12:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=25.08776092529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 37276624-7cd6-4c7d-9189-3081a532e995 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:12:18 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:12:19 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:12:19 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:12:19 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:12:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:12:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:12:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:12:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:12:23 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updating instance_info_cache with network_info: [{"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-37276624-7cd6-4c7d-9189-3081a532e995" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKtLBGfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:12:24 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:12:24 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:12:24 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f18fdaa-bc26-4432-a7fd-e137ea3e7beb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:12:24 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[810608f3-b233-4199-b7b3-288d70d6345c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b] added
Aug 14 22:12:24 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad94081-283d-4e51-abca-60234f01ec02]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:24 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce6ced-4284-47a8-b5d6-0b6fe248e6b4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKtLBGfl {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKtLBGfl" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62372f-00d8-45b4-a2cc-412526d8fd21]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKtLBGfl'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d006069d-ae19-4d28-814f-c2b0946afc37]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc37c55-2051-4cca-9f6d-521c1a8ecb9f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 22:12:25 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 22:12:25 user nova-compute[73144]:  {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:12:25 user nova-compute[73144]: WARNING os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 22:12:25 user nova-compute[73144]: 
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3915f2f-3156-407e-92ab-05555a5ef6e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260]
Aug 14 22:12:25 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260] successful.
Aug 14 22:12:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8b061c-bfb7-45e2-889c-b16742f57d9f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e91aee-3f35-42a1-94ef-53575f8d9601]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:12:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:12:25 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb83d84-1401-4c0d-a50f-d2c06863520c]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKtLBGfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:12:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23161653436623063', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653436623063', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'flavor' on Instance uuid 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:12:26 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:12:26 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:12:26 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:12:26 user nova-compute[73144]:   <serial>62e9856c-3371-4918-841d-4c39916bed3b</serial>
Aug 14 22:12:26 user nova-compute[73144]: </disk>
Aug 14 22:12:26 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No VIF found with MAC fa:16:3e:10:b0:25, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-09703d12-7dac-43b9-aae7-5c664fd12a7b tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.541s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:12:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:44 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:12:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:12:46 user nova-compute[73144]: INFO nova.compute.claims [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Claim successful on node user
Aug 14 22:12:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:12:47 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:12:47 user nova-compute[73144]: INFO nova.virt.block_device [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Booting with volume 078af43c-80ec-4edd-836f-657c7718a7ff at /dev/vda
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.policy [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a3e93f724b43a08ee42b79c63ed4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f796a65843b467a9889f47789c87eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG os_brick.utils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e8a405-8986-4749-8b48-f0ffa56f6e53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4117a-e565-4c4d-9d9e-17c6f4d19fe5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d68d79-897e-4f9e-b11d-5af00de0660d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e88604-8886-428b-8bee-2b168c1588a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:12:47 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:12:47 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bacaf6-c249-4255-936c-955b02926941]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG os_brick.utils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:12:47 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updating existing volume attachment record: 217d9590-288a-4e5b-9ab1-b6be2d2a120f {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:12:48 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Successfully created port: 22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Successfully updated port: 22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquired lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-changed-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Refreshing instance network info cache due to event network-changed-22591a2b-58b9-4518-9958-2cdcd91c7948. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] Acquiring lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updating instance_info_cache with network_info: [{"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Releasing lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Instance network_info: |[{"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] Acquired lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Refreshing network info cache for port 22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updated VIF entry in instance network info cache for port 22591a2b-58b9-4518-9958-2cdcd91c7948. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG nova.network.neutron [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updating instance_info_cache with network_info: [{"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:12:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-86a800eb-03ce-4f70-a220-c99884ced329 req-4eb5da28-c055-4f01-8ea7-9190b0a55063 service nova] Releasing lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:12:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:12:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Creating image(s)
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Ensure instance console log exists: /opt/stack/data/nova/instances/a4b4426c-82ae-4b99-81aa-4d920d4b6fac/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Start _get_guest_xml network_info=[{"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '217d9590-288a-4e5b-9ab1-b6be2d2a120f', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4b4426c-82ae-4b99-81aa-4d920d4b6fac', 'attached_at': '', 'detached_at': '', 'volume_id': '078af43c-80ec-4edd-836f-657c7718a7ff', 'serial': '078af43c-80ec-4edd-836f-657c7718a7ff'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:12:56 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:12:56 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:12:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:12:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:12:56 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c106a-8c05-4fc7-a7bf-e0f2e85b1001]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:12:56 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad82114-6152-4029-9bcb-f8da3efc3c52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff] added
Aug 14 22:12:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da75869-473a-41d0-a978-c4f84c3c1925]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ef68c-2f8f-4691-adac-c4defb1ff4b0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSGgPmyr {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSGgPmyr" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0ac77-1067-42b0-8ed5-10c7f453be04]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jSGgPmyr'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada88e62-9593-4881-b116-bb62715938b1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2714d9e-7212-4da3-85bd-fd634bad5aec]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:12:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:12:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf7f603-f7ef-454f-ae2a-c113676c3ce5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]
Aug 14 22:12:56 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.
Aug 14 22:12:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de100078-95c1-4ac8-b411-b2c5807e5ae7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb69e055-3d31-4e80-9f12-7fe25fc6a34d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:12:56 user nova-compute[73144]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:12:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:12:56 user nova-compute[73144]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:12:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3be206d-d09e-4d95-a55c-842dd8146aa2]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:12:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26333326436633965', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333326436633965', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1311828864',display_name='tempest-TestVolumeBootPattern-server-1311828864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1311828864',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-dfll6tdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:12:47Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=a4b4426c-82ae-4b99-81aa-4d920d4b6fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a2:df,bridge_name='br-int',has_traffic_filtering=True,id=22591a2b-58b9-4518-9958-2cdcd91c7948,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22591a2b-58') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'pci_devices' on Instance uuid a4b4426c-82ae-4b99-81aa-4d920d4b6fac {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:12:57 user nova-compute[73144]:   <uuid>a4b4426c-82ae-4b99-81aa-4d920d4b6fac</uuid>
Aug 14 22:12:57 user nova-compute[73144]:   <name>instance-0000002f</name>
Aug 14 22:12:57 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:12:57 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:12:57 user nova-compute[73144]:   <metadata>
Aug 14 22:12:57 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:12:57 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:12:57 user nova-compute[73144]:       <nova:name>tempest-TestVolumeBootPattern-server-1311828864</nova:name>
Aug 14 22:12:57 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:12:56</nova:creationTime>
Aug 14 22:12:57 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:12:57 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:12:57 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:12:57 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:12:57 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:12:57 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:12:57 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:12:57 user nova-compute[73144]:       <nova:owner>
Aug 14 22:12:57 user nova-compute[73144]:         <nova:user uuid="52a3e93f724b43a08ee42b79c63ed4d0">tempest-TestVolumeBootPattern-790116957-project-member</nova:user>
Aug 14 22:12:57 user nova-compute[73144]:         <nova:project uuid="0f796a65843b467a9889f47789c87eed">tempest-TestVolumeBootPattern-790116957</nova:project>
Aug 14 22:12:57 user nova-compute[73144]:       </nova:owner>
Aug 14 22:12:57 user nova-compute[73144]:       <nova:ports>
Aug 14 22:12:57 user nova-compute[73144]:         <nova:port uuid="22591a2b-58b9-4518-9958-2cdcd91c7948">
Aug 14 22:12:57 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 22:12:57 user nova-compute[73144]:         </nova:port>
Aug 14 22:12:57 user nova-compute[73144]:       </nova:ports>
Aug 14 22:12:57 user nova-compute[73144]:     </nova:instance>
Aug 14 22:12:57 user nova-compute[73144]:   </metadata>
Aug 14 22:12:57 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:12:57 user nova-compute[73144]:     <system>
Aug 14 22:12:57 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:12:57 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:12:57 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:12:57 user nova-compute[73144]:       <entry name="serial">a4b4426c-82ae-4b99-81aa-4d920d4b6fac</entry>
Aug 14 22:12:57 user nova-compute[73144]:       <entry name="uuid">a4b4426c-82ae-4b99-81aa-4d920d4b6fac</entry>
Aug 14 22:12:57 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:12:57 user nova-compute[73144]:     </system>
Aug 14 22:12:57 user nova-compute[73144]:   </sysinfo>
Aug 14 22:12:57 user nova-compute[73144]:   <os>
Aug 14 22:12:57 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:12:57 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:12:57 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:12:57 user nova-compute[73144]:   </os>
Aug 14 22:12:57 user nova-compute[73144]:   <features>
Aug 14 22:12:57 user nova-compute[73144]:     <acpi/>
Aug 14 22:12:57 user nova-compute[73144]:     <apic/>
Aug 14 22:12:57 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:12:57 user nova-compute[73144]:   </features>
Aug 14 22:12:57 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:12:57 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:12:57 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:12:57 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:12:57 user nova-compute[73144]:   </clock>
Aug 14 22:12:57 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:12:57 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:12:57 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:12:57 user nova-compute[73144]:   </cpu>
Aug 14 22:12:57 user nova-compute[73144]:   <devices>
Aug 14 22:12:57 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:12:57 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:12:57 user nova-compute[73144]:       <source dev="/dev/sdc"/>
Aug 14 22:12:57 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:12:57 user nova-compute[73144]:       <serial>078af43c-80ec-4edd-836f-657c7718a7ff</serial>
Aug 14 22:12:57 user nova-compute[73144]:     </disk>
Aug 14 22:12:57 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:12:57 user nova-compute[73144]:       <mac address="fa:16:3e:97:a2:df"/>
Aug 14 22:12:57 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:12:57 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:12:57 user nova-compute[73144]:       <target dev="tap22591a2b-58"/>
Aug 14 22:12:57 user nova-compute[73144]:     </interface>
Aug 14 22:12:57 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:12:57 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/a4b4426c-82ae-4b99-81aa-4d920d4b6fac/console.log" append="off"/>
Aug 14 22:12:57 user nova-compute[73144]:     </serial>
Aug 14 22:12:57 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:12:57 user nova-compute[73144]:     <video>
Aug 14 22:12:57 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:12:57 user nova-compute[73144]:     </video>
Aug 14 22:12:57 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:12:57 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:12:57 user nova-compute[73144]:     </rng>
Aug 14 22:12:57 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:12:57 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:12:57 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:12:57 user nova-compute[73144]:     </memballoon>
Aug 14 22:12:57 user nova-compute[73144]:   </devices>
Aug 14 22:12:57 user nova-compute[73144]: </domain>
Aug 14 22:12:57 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1311828864',display_name='tempest-TestVolumeBootPattern-server-1311828864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1311828864',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-dfll6tdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:12:47Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=a4b4426c-82ae-4b99-81aa-4d920d4b6fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a2:df,bridge_name='br-int',has_traffic_filtering=True,id=22591a2b-58b9-4518-9958-2cdcd91c7948,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22591a2b-58') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG os_vif [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a2:df,bridge_name='br-int',has_traffic_filtering=True,id=22591a2b-58b9-4518-9958-2cdcd91c7948,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22591a2b-58') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22591a2b-58, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22591a2b-58, col_values=(('external_ids', {'iface-id': '22591a2b-58b9-4518-9958-2cdcd91c7948', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:a2:df', 'vm-uuid': 'a4b4426c-82ae-4b99-81aa-4d920d4b6fac'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:12:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:57 user nova-compute[73144]: INFO os_vif [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a2:df,bridge_name='br-int',has_traffic_filtering=True,id=22591a2b-58b9-4518-9958-2cdcd91c7948,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22591a2b-58')
Aug 14 22:12:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:12:58 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No VIF found with MAC fa:16:3e:97:a2:df, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-877ec5af-03a8-4f0a-a13f-a8ec630cd898 req-9fd87e53-85a5-4c7b-b51e-d125dab2a7ba service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-877ec5af-03a8-4f0a-a13f-a8ec630cd898 req-9fd87e53-85a5-4c7b-b51e-d125dab2a7ba service nova] Acquiring lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-877ec5af-03a8-4f0a-a13f-a8ec630cd898 req-9fd87e53-85a5-4c7b-b51e-d125dab2a7ba service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-877ec5af-03a8-4f0a-a13f-a8ec630cd898 req-9fd87e53-85a5-4c7b-b51e-d125dab2a7ba service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-877ec5af-03a8-4f0a-a13f-a8ec630cd898 req-9fd87e53-85a5-4c7b-b51e-d125dab2a7ba service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] No waiting events found dispatching network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:12:59 user nova-compute[73144]: WARNING nova.compute.manager [req-877ec5af-03a8-4f0a-a13f-a8ec630cd898 req-9fd87e53-85a5-4c7b-b51e-d125dab2a7ba service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received unexpected event network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 for instance with vm_state building and task_state spawning.
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:12:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051181.5001853, a4b4426c-82ae-4b99-81aa-4d920d4b6fac => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:13:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] VM Resumed (Lifecycle Event)
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:13:01 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Instance spawned successfully.
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051181.502357, a4b4426c-82ae-4b99-81aa-4d920d4b6fac => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:13:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] VM Started (Lifecycle Event)
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-f4f3d1d3-b72f-4840-9595-085ef6f3205a req-e82d8e4e-32c8-4606-9473-d16d2b69b0d4 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f4f3d1d3-b72f-4840-9595-085ef6f3205a req-e82d8e4e-32c8-4606-9473-d16d2b69b0d4 service nova] Acquiring lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f4f3d1d3-b72f-4840-9595-085ef6f3205a req-e82d8e4e-32c8-4606-9473-d16d2b69b0d4 service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f4f3d1d3-b72f-4840-9595-085ef6f3205a req-e82d8e4e-32c8-4606-9473-d16d2b69b0d4 service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-f4f3d1d3-b72f-4840-9595-085ef6f3205a req-e82d8e4e-32c8-4606-9473-d16d2b69b0d4 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] No waiting events found dispatching network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:01 user nova-compute[73144]: WARNING nova.compute.manager [req-f4f3d1d3-b72f-4840-9595-085ef6f3205a req-e82d8e4e-32c8-4606-9473-d16d2b69b0d4 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received unexpected event network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 for instance with vm_state building and task_state spawning.
Aug 14 22:13:01 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:13:01 user nova-compute[73144]: INFO nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 14 22:13:01 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:13:01 user nova-compute[73144]: INFO nova.compute.manager [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Took 14.92 seconds to build instance.
Aug 14 22:13:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2f980af9-d997-41c0-89fd-923e77290515 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.025s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:10 user nova-compute[73144]: INFO nova.compute.manager [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Detaching volume 62e9856c-3371-4918-841d-4c39916bed3b
Aug 14 22:13:10 user nova-compute[73144]: INFO nova.virt.block_device [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Attempting to driver detach volume 62e9856c-3371-4918-841d-4c39916bed3b from mountpoint /dev/vdb
Aug 14 22:13:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Attempting to detach device vdb from instance 37276624-7cd6-4c7d-9189-3081a532e995 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:13:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:13:10 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:13:10 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:13:10 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:13:10 user nova-compute[73144]:   <serial>62e9856c-3371-4918-841d-4c39916bed3b</serial>
Aug 14 22:13:10 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:13:10 user nova-compute[73144]: </disk>
Aug 14 22:13:10 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:13:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully detached device vdb from instance 37276624-7cd6-4c7d-9189-3081a532e995 from the persistent domain config.
Aug 14 22:13:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37276624-7cd6-4c7d-9189-3081a532e995 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:13:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:13:10 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:13:10 user nova-compute[73144]:   <source dev="/dev/sdb"/>
Aug 14 22:13:10 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:13:10 user nova-compute[73144]:   <serial>62e9856c-3371-4918-841d-4c39916bed3b</serial>
Aug 14 22:13:10 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:13:10 user nova-compute[73144]: </disk>
Aug 14 22:13:10 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692051191.4168088, 37276624-7cd6-4c7d-9189-3081a532e995 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:13:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully detached device vdb from instance 37276624-7cd6-4c7d-9189-3081a532e995 from the live domain config.
Aug 14 22:13:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKtLBGfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:13:11 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26e6c5c-64ba-4b18-a4db-35c9aebf22d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7a31e-efee-4278-8130-b26ad325f627]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:13:11 user nova-compute[73144]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b (non-flash)
Aug 14 22:13:11 user nova-compute[73144]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa17850b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1858c8e-03c3-4614-91cd-1abfab1bbb7b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[02677612-32f3-4017-85bc-32cbdca0cc6b]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff267e2-acd1-4ee4-82dc-db3d882fe369]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5cba25-663e-4021-9c8a-590b25eea827]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea134aa-92a7-4701-9d64-e51d3e34eaa8]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113ee5e-eb7c-4c6e-a3ba-3b1aff0dedb6]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260]
Aug 14 22:13:11 user nova-compute[73144]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b, portal: 172.16.0.220,3260] successful.
Aug 14 22:13:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1915be8c-add7-471d-9f77-0b39f31fa4d4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== disconnect_volume: return (302ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:13:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG nova.objects.instance [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'flavor' on Instance uuid 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-577106d9-824d-468b-a9d0-b542a332ba33 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.569s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:12 user nova-compute[73144]: INFO nova.compute.manager [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Terminating instance
Aug 14 22:13:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-153aa932-e141-4186-85ed-71b8a9091e95 req-79ee0ea5-39ce-48e1-8f10-e564e21b6579 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-unplugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-153aa932-e141-4186-85ed-71b8a9091e95 req-79ee0ea5-39ce-48e1-8f10-e564e21b6579 service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-153aa932-e141-4186-85ed-71b8a9091e95 req-79ee0ea5-39ce-48e1-8f10-e564e21b6579 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-153aa932-e141-4186-85ed-71b8a9091e95 req-79ee0ea5-39ce-48e1-8f10-e564e21b6579 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-153aa932-e141-4186-85ed-71b8a9091e95 req-79ee0ea5-39ce-48e1-8f10-e564e21b6579 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-unplugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-153aa932-e141-4186-85ed-71b8a9091e95 req-79ee0ea5-39ce-48e1-8f10-e564e21b6579 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-unplugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:13:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Instance destroyed successfully.
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'resources' on Instance uuid 37276624-7cd6-4c7d-9189-3081a532e995 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2136094803',display_name='tempest-VolumesSnapshotTestJSON-instance-2136094803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2136094803',id=46,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBSMd/WLDZudgIJxadDUogxtqPeQFt0FFB5WY24yFL2tIF9kLe2j0fj2TJiDHM3v8PkDMz25oXDLaTIu1+oHA199qmAS79TQZC9oWxKy8ht4pAnV5uspnnQLuQ4vYE/sw==',key_name='tempest-keypair-1952028321',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:10:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33768265e13b425c9338be4ed4242a29',ramdisk_id='',reservation_id='r-b2ldrprz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1006768833',owner_user_name='tempest-VolumesSnapshotTestJSON-1006768833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25e50ade908b447aaeb5dac6a9bb33af',uuid=37276624-7cd6-4c7d-9189-3081a532e995,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converting VIF {"id": "293f3220-f3d6-4d8a-a252-2791f319c059", "address": "fa:16:3e:10:b0:25", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap293f3220-f3", "ovs_interfaceid": "293f3220-f3d6-4d8a-a252-2791f319c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:b0:25,bridge_name='br-int',has_traffic_filtering=True,id=293f3220-f3d6-4d8a-a252-2791f319c059,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap293f3220-f3') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_vif [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:b0:25,bridge_name='br-int',has_traffic_filtering=True,id=293f3220-f3d6-4d8a-a252-2791f319c059,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap293f3220-f3') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap293f3220-f3, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:13:13 user nova-compute[73144]: INFO os_vif [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:b0:25,bridge_name='br-int',has_traffic_filtering=True,id=293f3220-f3d6-4d8a-a252-2791f319c059,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap293f3220-f3')
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKtLBGfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:13:13 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e9856c-3371-4918-841d-4c39916bed3b', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dabb0c-04d6-4fb6-bae9-99b3fd94fc75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[87afdbc0-4393-489c-9d08-3c24347b0b51]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1782811b0>, {}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Disconnecting from: [] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== disconnect_volume: return (52ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:13:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Deleting instance files /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995_del
Aug 14 22:13:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Deletion of /opt/stack/data/nova/instances/37276624-7cd6-4c7d-9189-3081a532e995_del complete
Aug 14 22:13:13 user nova-compute[73144]: INFO nova.compute.manager [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 14 22:13:13 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:15 user nova-compute[73144]: WARNING nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received unexpected event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with vm_state active and task_state deleting.
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:15 user nova-compute[73144]: WARNING nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received unexpected event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with vm_state active and task_state deleting.
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:15 user nova-compute[73144]: WARNING nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received unexpected event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with vm_state active and task_state deleting.
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-unplugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-unplugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-be3e5a5a-0814-4f0f-8c28-72d7bd2c8cd4 req-1bd80091-6a5d-4ce3-9451-08fec596ec59 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-unplugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:13:15 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Took 1.90 seconds to deallocate network for instance.
Aug 14 22:13:15 user nova-compute[73144]: WARNING nova.volume.cinder [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Attachment 34dd0e14-7bab-4d5f-b963-15a37d72315b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 34dd0e14-7bab-4d5f-b963-15a37d72315b. (HTTP 404) (Request-ID: req-cb256d86-c909-466b-9fa5-f6226aceb090)
Aug 14 22:13:15 user nova-compute[73144]: INFO nova.compute.manager [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:15 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Deleted allocations for instance 37276624-7cd6-4c7d-9189-3081a532e995
Aug 14 22:13:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d1118bea-8935-4b76-8f88-c21f44320268 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "37276624-7cd6-4c7d-9189-3081a532e995" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.258s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c3982549-5d8d-40ce-a340-0e47c53a93f8 req-e3ae5a2a-c1de-465a-9ff5-201fbaa671e8 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c3982549-5d8d-40ce-a340-0e47c53a93f8 req-e3ae5a2a-c1de-465a-9ff5-201fbaa671e8 service nova] Acquiring lock "37276624-7cd6-4c7d-9189-3081a532e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c3982549-5d8d-40ce-a340-0e47c53a93f8 req-e3ae5a2a-c1de-465a-9ff5-201fbaa671e8 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c3982549-5d8d-40ce-a340-0e47c53a93f8 req-e3ae5a2a-c1de-465a-9ff5-201fbaa671e8 service nova] Lock "37276624-7cd6-4c7d-9189-3081a532e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c3982549-5d8d-40ce-a340-0e47c53a93f8 req-e3ae5a2a-c1de-465a-9ff5-201fbaa671e8 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] No waiting events found dispatching network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:17 user nova-compute[73144]: WARNING nova.compute.manager [req-c3982549-5d8d-40ce-a340-0e47c53a93f8 req-e3ae5a2a-c1de-465a-9ff5-201fbaa671e8 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received unexpected event network-vif-plugged-293f3220-f3d6-4d8a-a252-2791f319c059 for instance with vm_state deleted and task_state None.
Aug 14 22:13:17 user nova-compute[73144]: DEBUG nova.compute.manager [req-c3982549-5d8d-40ce-a340-0e47c53a93f8 req-e3ae5a2a-c1de-465a-9ff5-201fbaa671e8 service nova] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Received event network-vif-deleted-293f3220-f3d6-4d8a-a252-2791f319c059 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:13:19 user nova-compute[73144]: INFO nova.compute.claims [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Claim successful on node user
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:13:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:13:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8422MB free_disk=25.149738311767578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:20 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:13:20 user nova-compute[73144]: INFO nova.virt.block_device [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Booting with volume dd57b1db-9896-40c9-8cd1-d508c863db0a at /dev/vda
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance a4b4426c-82ae-4b99-81aa-4d920d4b6fac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG os_brick.utils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dfe69d-67a0-4f24-ba12-b76da58817a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.policy [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53ae193a68f448e18a778310ae8ecc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cd8e6173bf4dc38aa9f99c854f5df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[434d76f0-f55f-4432-a2d7-63b687f4971d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d017c-6f75-4b84-8191-bb08295abf29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79cff61-87b3-4253-a8f0-89fcb08240a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:13:20 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:13:20 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[65259813-b544-4b52-8041-666479c4792b]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG os_brick.utils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:13:20 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating existing volume attachment record: deb121e7-381f-4903-81e4-8a2f85a6da89 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:13:21 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Successfully created port: b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:13:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Successfully updated port: b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.compute.manager [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing instance network info cache due to event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.network.neutron [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance network_info: |[{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:13:22 user nova-compute[73144]: DEBUG nova.network.neutron [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:13:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updated VIF entry in instance network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:13:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:13:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-962ea18b-6ef9-4147-9aa6-84e32f23d804 req-02ccc851-7db8-4d71-81a7-062b90bb3677 service nova] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:13:23 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Skipping network cache update for instance because it is Building. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:13:24 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:13:25 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updating instance_info_cache with network_info: [{"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:13:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-9e9d6b63-cc96-431f-ab2f-733809ffdcb3" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:13:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:13:25 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:28 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051193.336493, 37276624-7cd6-4c7d-9189-3081a532e995 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:13:28 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] VM Stopped (Lifecycle Event)
Aug 14 22:13:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2e844aa0-9f4b-4d64-8390-1958a4589317 None None] [instance: 37276624-7cd6-4c7d-9189-3081a532e995] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:13:28 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:13:29 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Creating image(s)
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Ensure instance console log exists: /opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Start _get_guest_xml network_info=[{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'deb121e7-381f-4903-81e4-8a2f85a6da89', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57f47674-a3c4-44d9-8b02-0b3bdeae5c62', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd57b1db-9896-40c9-8cd1-d508c863db0a', 'serial': 'dd57b1db-9896-40c9-8cd1-d508c863db0a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:13:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:13:29 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:13:29 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:13:29 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:13:29 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d4c39-e4f2-4a1c-86ed-b6f06092703d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:13:29 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4df957-f2be-4f83-a29b-fb0f9522290f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a] added
Aug 14 22:13:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[51536fd9-4465-41e8-8c66-be89bddc36ec]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65c37e-7748-442a-a744-ed62376a8966]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJUdjgZq {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJUdjgZq" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c437b93-a99b-4f03-8688-9640ccbd9356]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJUdjgZq'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[928e18fe-1282-4b1b-bf59-cbb438f9871b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb16ea1-b57f-416e-a100-0c15803219a1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebd9c4a-8b1c-4997-82f1-18cc9d6bcfad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]
Aug 14 22:13:29 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.
Aug 14 22:13:29 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[693bf55e-0452-4999-9d58-70e379303448]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:13:29 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[746bc133-03e9-44da-9876-f7047fd2c0f3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:30 user nova-compute[73144]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:13:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:13:30 user nova-compute[73144]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:13:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01e3796-dbb5-4ddb-955c-a099891be76b]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:13:30 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26264626131393966', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264626131393966', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1582032628',display_name='tempest-TestShelveInstance-server-1582032628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1582032628',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyjogbPWdMjyrXe3p70Vul0z43jN2t4FRLtvhfLhpoiAv+aTDsfm7ezczVgMwRuRjvbdVAI9pYKMA6a2GIU3QB/32e1FH53z+NlI1u6N3rDgRaRP7/tSZGvHrQtzg81kw==',key_name='tempest-TestShelveInstance-1810898075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6cd8e6173bf4dc38aa9f99c854f5df4',ramdisk_id='',reservation_id='r-yx9lj9r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1754427089',owner_user_name='tempest-TestShelveInstance-1754427089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:13:21Z,user_data=None,user_id='53ae193a68f448e18a778310ae8ecc04',uuid=57f47674-a3c4-44d9-8b02-0b3bdeae5c62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converting VIF {"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'pci_devices' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:13:31 user nova-compute[73144]:   <uuid>57f47674-a3c4-44d9-8b02-0b3bdeae5c62</uuid>
Aug 14 22:13:31 user nova-compute[73144]:   <name>instance-00000030</name>
Aug 14 22:13:31 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:13:31 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:13:31 user nova-compute[73144]:   <metadata>
Aug 14 22:13:31 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:13:31 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:13:31 user nova-compute[73144]:       <nova:name>tempest-TestShelveInstance-server-1582032628</nova:name>
Aug 14 22:13:31 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:13:29</nova:creationTime>
Aug 14 22:13:31 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:13:31 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:13:31 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:13:31 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:13:31 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:13:31 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:13:31 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:13:31 user nova-compute[73144]:       <nova:owner>
Aug 14 22:13:31 user nova-compute[73144]:         <nova:user uuid="53ae193a68f448e18a778310ae8ecc04">tempest-TestShelveInstance-1754427089-project-member</nova:user>
Aug 14 22:13:31 user nova-compute[73144]:         <nova:project uuid="c6cd8e6173bf4dc38aa9f99c854f5df4">tempest-TestShelveInstance-1754427089</nova:project>
Aug 14 22:13:31 user nova-compute[73144]:       </nova:owner>
Aug 14 22:13:31 user nova-compute[73144]:       <nova:ports>
Aug 14 22:13:31 user nova-compute[73144]:         <nova:port uuid="b792bbc1-9911-4ab8-8563-18c34dd9e644">
Aug 14 22:13:31 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 22:13:31 user nova-compute[73144]:         </nova:port>
Aug 14 22:13:31 user nova-compute[73144]:       </nova:ports>
Aug 14 22:13:31 user nova-compute[73144]:     </nova:instance>
Aug 14 22:13:31 user nova-compute[73144]:   </metadata>
Aug 14 22:13:31 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:13:31 user nova-compute[73144]:     <system>
Aug 14 22:13:31 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:13:31 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:13:31 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:13:31 user nova-compute[73144]:       <entry name="serial">57f47674-a3c4-44d9-8b02-0b3bdeae5c62</entry>
Aug 14 22:13:31 user nova-compute[73144]:       <entry name="uuid">57f47674-a3c4-44d9-8b02-0b3bdeae5c62</entry>
Aug 14 22:13:31 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:13:31 user nova-compute[73144]:     </system>
Aug 14 22:13:31 user nova-compute[73144]:   </sysinfo>
Aug 14 22:13:31 user nova-compute[73144]:   <os>
Aug 14 22:13:31 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:13:31 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:13:31 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:13:31 user nova-compute[73144]:   </os>
Aug 14 22:13:31 user nova-compute[73144]:   <features>
Aug 14 22:13:31 user nova-compute[73144]:     <acpi/>
Aug 14 22:13:31 user nova-compute[73144]:     <apic/>
Aug 14 22:13:31 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:13:31 user nova-compute[73144]:   </features>
Aug 14 22:13:31 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:13:31 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:13:31 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:13:31 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:13:31 user nova-compute[73144]:   </clock>
Aug 14 22:13:31 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:13:31 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:13:31 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:13:31 user nova-compute[73144]:   </cpu>
Aug 14 22:13:31 user nova-compute[73144]:   <devices>
Aug 14 22:13:31 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:13:31 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:13:31 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 22:13:31 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:13:31 user nova-compute[73144]:       <serial>dd57b1db-9896-40c9-8cd1-d508c863db0a</serial>
Aug 14 22:13:31 user nova-compute[73144]:     </disk>
Aug 14 22:13:31 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:13:31 user nova-compute[73144]:       <mac address="fa:16:3e:3f:26:ab"/>
Aug 14 22:13:31 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:13:31 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:13:31 user nova-compute[73144]:       <target dev="tapb792bbc1-99"/>
Aug 14 22:13:31 user nova-compute[73144]:     </interface>
Aug 14 22:13:31 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:13:31 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62/console.log" append="off"/>
Aug 14 22:13:31 user nova-compute[73144]:     </serial>
Aug 14 22:13:31 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:13:31 user nova-compute[73144]:     <video>
Aug 14 22:13:31 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:13:31 user nova-compute[73144]:     </video>
Aug 14 22:13:31 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:13:31 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:13:31 user nova-compute[73144]:     </rng>
Aug 14 22:13:31 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:13:31 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:13:31 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:13:31 user nova-compute[73144]:     </memballoon>
Aug 14 22:13:31 user nova-compute[73144]:   </devices>
Aug 14 22:13:31 user nova-compute[73144]: </domain>
Aug 14 22:13:31 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1582032628',display_name='tempest-TestShelveInstance-server-1582032628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1582032628',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyjogbPWdMjyrXe3p70Vul0z43jN2t4FRLtvhfLhpoiAv+aTDsfm7ezczVgMwRuRjvbdVAI9pYKMA6a2GIU3QB/32e1FH53z+NlI1u6N3rDgRaRP7/tSZGvHrQtzg81kw==',key_name='tempest-TestShelveInstance-1810898075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6cd8e6173bf4dc38aa9f99c854f5df4',ramdisk_id='',reservation_id='r-yx9lj9r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1754427089',owner_user_name='tempest-TestShelveInstance-1754427089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:13:21Z,user_data=None,user_id='53ae193a68f448e18a778310ae8ecc04',uuid=57f47674-a3c4-44d9-8b02-0b3bdeae5c62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converting VIF {"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG os_vif [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb792bbc1-99, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb792bbc1-99, col_values=(('external_ids', {'iface-id': 'b792bbc1-9911-4ab8-8563-18c34dd9e644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:26:ab', 'vm-uuid': '57f47674-a3c4-44d9-8b02-0b3bdeae5c62'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:31 user nova-compute[73144]: INFO os_vif [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99')
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:13:31 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] No VIF found with MAC fa:16:3e:3f:26:ab, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-f55d54ac-888c-4e2a-94fd-4030d27b4ac8 req-5701c884-8762-44dc-bc0e-97c82a1d8071 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f55d54ac-888c-4e2a-94fd-4030d27b4ac8 req-5701c884-8762-44dc-bc0e-97c82a1d8071 service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f55d54ac-888c-4e2a-94fd-4030d27b4ac8 req-5701c884-8762-44dc-bc0e-97c82a1d8071 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f55d54ac-888c-4e2a-94fd-4030d27b4ac8 req-5701c884-8762-44dc-bc0e-97c82a1d8071 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:32 user nova-compute[73144]: DEBUG nova.compute.manager [req-f55d54ac-888c-4e2a-94fd-4030d27b4ac8 req-5701c884-8762-44dc-bc0e-97c82a1d8071 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:32 user nova-compute[73144]: WARNING nova.compute.manager [req-f55d54ac-888c-4e2a-94fd-4030d27b4ac8 req-5701c884-8762-44dc-bc0e-97c82a1d8071 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received unexpected event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with vm_state building and task_state spawning.
Aug 14 22:13:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:33 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051214.6139245, 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:13:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] VM Resumed (Lifecycle Event)
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:13:34 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance spawned successfully.
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:13:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051214.6173701, 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:13:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] VM Started (Lifecycle Event)
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:13:34 user nova-compute[73144]: INFO nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:13:34 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:13:34 user nova-compute[73144]: INFO nova.compute.manager [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Took 15.08 seconds to build instance.
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-b13e67b6-5521-42a5-998d-fbc1bcbc525c req-6f9ed06a-600b-40a3-b6f0-6df5d6202544 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b13e67b6-5521-42a5-998d-fbc1bcbc525c req-6f9ed06a-600b-40a3-b6f0-6df5d6202544 service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b13e67b6-5521-42a5-998d-fbc1bcbc525c req-6f9ed06a-600b-40a3-b6f0-6df5d6202544 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b13e67b6-5521-42a5-998d-fbc1bcbc525c req-6f9ed06a-600b-40a3-b6f0-6df5d6202544 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:34 user nova-compute[73144]: DEBUG nova.compute.manager [req-b13e67b6-5521-42a5-998d-fbc1bcbc525c req-6f9ed06a-600b-40a3-b6f0-6df5d6202544 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:13:34 user nova-compute[73144]: WARNING nova.compute.manager [req-b13e67b6-5521-42a5-998d-fbc1bcbc525c req-6f9ed06a-600b-40a3-b6f0-6df5d6202544 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received unexpected event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with vm_state active and task_state None.
Aug 14 22:13:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4d6762e2-b283-4e7c-9527-1bf9835d1153 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.209s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:13:36 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:13:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:14:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:14:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:14:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8392MB free_disk=25.137981414794922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance a4b4426c-82ae-4b99-81aa-4d920d4b6fac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:14:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:14:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:14:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:14:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:14:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:14:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:27 user nova-compute[73144]: INFO nova.compute.manager [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Terminating instance
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updating instance_info_cache with network_info: [{"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-5f405fb9-8bea-4c95-96fb-cdebb7dbfeb4 req-c29fc861-657f-4970-8c76-1b8c40800d0a service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received event network-vif-unplugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5f405fb9-8bea-4c95-96fb-cdebb7dbfeb4 req-c29fc861-657f-4970-8c76-1b8c40800d0a service nova] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5f405fb9-8bea-4c95-96fb-cdebb7dbfeb4 req-c29fc861-657f-4970-8c76-1b8c40800d0a service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-5f405fb9-8bea-4c95-96fb-cdebb7dbfeb4 req-c29fc861-657f-4970-8c76-1b8c40800d0a service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-5f405fb9-8bea-4c95-96fb-cdebb7dbfeb4 req-c29fc861-657f-4970-8c76-1b8c40800d0a service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] No waiting events found dispatching network-vif-unplugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.compute.manager [req-5f405fb9-8bea-4c95-96fb-cdebb7dbfeb4 req-c29fc861-657f-4970-8c76-1b8c40800d0a service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received event network-vif-unplugged-86eba6fd-e57e-4530-b80f-d966b2db71af for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:14:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Instance destroyed successfully.
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lazy-loading 'resources' on Instance uuid 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-69473342',display_name='tempest-ServersNegativeTestJSON-server-69473342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-69473342',id=41,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:05:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17398a626e67472e81402db4abe498e1',ramdisk_id='',reservation_id='r-o9pw83o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1712834715',owner_user_name='tempest-ServersNegativeTestJSON-1712834715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:05:33Z,user_data=None,user_id='43342fae8732443c990af06487af5c0b',uuid=9e9d6b63-cc96-431f-ab2f-733809ffdcb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converting VIF {"id": "86eba6fd-e57e-4530-b80f-d966b2db71af", "address": "fa:16:3e:c2:57:f9", "network": {"id": "91d4ae45-007c-4aa3-b707-6eea9d9cf5a3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-653255764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17398a626e67472e81402db4abe498e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eba6fd-e5", "ovs_interfaceid": "86eba6fd-e57e-4530-b80f-d966b2db71af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=86eba6fd-e57e-4530-b80f-d966b2db71af,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eba6fd-e5') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG os_vif [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=86eba6fd-e57e-4530-b80f-d966b2db71af,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eba6fd-e5') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86eba6fd-e5, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:27 user nova-compute[73144]: INFO os_vif [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=86eba6fd-e57e-4530-b80f-d966b2db71af,network=Network(91d4ae45-007c-4aa3-b707-6eea9d9cf5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eba6fd-e5')
Aug 14 22:14:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Deleting instance files /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3_del
Aug 14 22:14:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Deletion of /opt/stack/data/nova/instances/9e9d6b63-cc96-431f-ab2f-733809ffdcb3_del complete
Aug 14 22:14:27 user nova-compute[73144]: INFO nova.compute.manager [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 14 22:14:27 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:14:27 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:14:28 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:14:28 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Took 0.56 seconds to deallocate network for instance.
Aug 14 22:14:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-79f8cbe5-a6f9-499d-b8e9-e6cbc0cb2abb req-942507fc-6a67-4caf-910c-a14c5bd1e0f6 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received event network-vif-deleted-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:28 user nova-compute[73144]: INFO nova.compute.manager [req-79f8cbe5-a6f9-499d-b8e9-e6cbc0cb2abb req-942507fc-6a67-4caf-910c-a14c5bd1e0f6 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Neutron deleted interface 86eba6fd-e57e-4530-b80f-d966b2db71af; detaching it from the instance and deleting it from the info cache
Aug 14 22:14:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-79f8cbe5-a6f9-499d-b8e9-e6cbc0cb2abb req-942507fc-6a67-4caf-910c-a14c5bd1e0f6 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:14:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-79f8cbe5-a6f9-499d-b8e9-e6cbc0cb2abb req-942507fc-6a67-4caf-910c-a14c5bd1e0f6 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Detach interface failed, port_id=86eba6fd-e57e-4530-b80f-d966b2db71af, reason: Instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:14:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:28 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:14:28 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:14:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:28 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Deleted allocations for instance 9e9d6b63-cc96-431f-ab2f-733809ffdcb3
Aug 14 22:14:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-6b424ab7-1353-469d-9ba1-6ec5bdf689db tempest-ServersNegativeTestJSON-1712834715 tempest-ServersNegativeTestJSON-1712834715-project-member] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.655s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-52097ef9-bc43-404c-a4a2-e88f84cf1221 req-158dd1c8-c54c-4de0-8362-9fd1b30c7d71 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received event network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-52097ef9-bc43-404c-a4a2-e88f84cf1221 req-158dd1c8-c54c-4de0-8362-9fd1b30c7d71 service nova] Acquiring lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-52097ef9-bc43-404c-a4a2-e88f84cf1221 req-158dd1c8-c54c-4de0-8362-9fd1b30c7d71 service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-52097ef9-bc43-404c-a4a2-e88f84cf1221 req-158dd1c8-c54c-4de0-8362-9fd1b30c7d71 service nova] Lock "9e9d6b63-cc96-431f-ab2f-733809ffdcb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-52097ef9-bc43-404c-a4a2-e88f84cf1221 req-158dd1c8-c54c-4de0-8362-9fd1b30c7d71 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] No waiting events found dispatching network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:14:29 user nova-compute[73144]: WARNING nova.compute.manager [req-52097ef9-bc43-404c-a4a2-e88f84cf1221 req-158dd1c8-c54c-4de0-8362-9fd1b30c7d71 service nova] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Received unexpected event network-vif-plugged-86eba6fd-e57e-4530-b80f-d966b2db71af for instance with vm_state deleted and task_state None.
Aug 14 22:14:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:14:35 user nova-compute[73144]: INFO nova.compute.claims [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Claim successful on node user
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.network.neutron [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:14:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.policy [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25e50ade908b447aaeb5dac6a9bb33af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33768265e13b425c9338be4ed4242a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:14:35 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Creating image(s)
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "/opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "/opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:35 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.189s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk 1073741824" returned: 0 in 0.055s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG nova.network.neutron [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Successfully created port: a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Cannot resize image /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG nova.objects.instance [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'migration_context' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Ensure instance console log exists: /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Successfully updated port: a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquired lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-changed-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.compute.manager [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Refreshing instance network info cache due to event network-changed-a6fdc5cf-91d6-466f-a2af-0f294d96da01. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] Acquiring lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating instance_info_cache with network_info: [{"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Releasing lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Instance network_info: |[{"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] Acquired lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.neutron [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Refreshing network info cache for port a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Start _get_guest_xml network_info=[{"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:14:37 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:14:37 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1902301298',display_name='tempest-VolumesSnapshotTestJSON-instance-1902301298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1902301298',id=49,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwZUGxkBH3OB5HhSfBTkCf3XzsV+kyIQhsmIACOp5O9vEWBDKoiHr8BUxWMTPBO58ZPZ2IoQfvRmSz3b2Ru7LhgvfTrFBR20splBdMKEUcWu0Euqy5ctRwFKmyNrPiA6A==',key_name='tempest-keypair-1316694006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33768265e13b425c9338be4ed4242a29',ramdisk_id='',reservation_id='r-1j31nm9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1006768833',owner_user_name='tempest-VolumesSnapshotTestJSON-1006768833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25e50ade908b447aaeb5dac6a9bb33af',uuid=c0d17b12-3516-4e9d-9fe1-87cc7e99a249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converting VIF {"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7b:e9,bridge_name='br-int',has_traffic_filtering=True,id=a6fdc5cf-91d6-466f-a2af-0f294d96da01,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6fdc5cf-91') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.objects.instance [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'pci_devices' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:14:37 user nova-compute[73144]:   <uuid>c0d17b12-3516-4e9d-9fe1-87cc7e99a249</uuid>
Aug 14 22:14:37 user nova-compute[73144]:   <name>instance-00000031</name>
Aug 14 22:14:37 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:14:37 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:14:37 user nova-compute[73144]:   <metadata>
Aug 14 22:14:37 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:14:37 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:14:37 user nova-compute[73144]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1902301298</nova:name>
Aug 14 22:14:37 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:14:37</nova:creationTime>
Aug 14 22:14:37 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:14:37 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:14:37 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:14:37 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:14:37 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:14:37 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:14:37 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:14:37 user nova-compute[73144]:       <nova:owner>
Aug 14 22:14:37 user nova-compute[73144]:         <nova:user uuid="25e50ade908b447aaeb5dac6a9bb33af">tempest-VolumesSnapshotTestJSON-1006768833-project-member</nova:user>
Aug 14 22:14:37 user nova-compute[73144]:         <nova:project uuid="33768265e13b425c9338be4ed4242a29">tempest-VolumesSnapshotTestJSON-1006768833</nova:project>
Aug 14 22:14:37 user nova-compute[73144]:       </nova:owner>
Aug 14 22:14:37 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:14:37 user nova-compute[73144]:       <nova:ports>
Aug 14 22:14:37 user nova-compute[73144]:         <nova:port uuid="a6fdc5cf-91d6-466f-a2af-0f294d96da01">
Aug 14 22:14:37 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 22:14:37 user nova-compute[73144]:         </nova:port>
Aug 14 22:14:37 user nova-compute[73144]:       </nova:ports>
Aug 14 22:14:37 user nova-compute[73144]:     </nova:instance>
Aug 14 22:14:37 user nova-compute[73144]:   </metadata>
Aug 14 22:14:37 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:14:37 user nova-compute[73144]:     <system>
Aug 14 22:14:37 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:14:37 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:14:37 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:14:37 user nova-compute[73144]:       <entry name="serial">c0d17b12-3516-4e9d-9fe1-87cc7e99a249</entry>
Aug 14 22:14:37 user nova-compute[73144]:       <entry name="uuid">c0d17b12-3516-4e9d-9fe1-87cc7e99a249</entry>
Aug 14 22:14:37 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:14:37 user nova-compute[73144]:     </system>
Aug 14 22:14:37 user nova-compute[73144]:   </sysinfo>
Aug 14 22:14:37 user nova-compute[73144]:   <os>
Aug 14 22:14:37 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:14:37 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:14:37 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:14:37 user nova-compute[73144]:   </os>
Aug 14 22:14:37 user nova-compute[73144]:   <features>
Aug 14 22:14:37 user nova-compute[73144]:     <acpi/>
Aug 14 22:14:37 user nova-compute[73144]:     <apic/>
Aug 14 22:14:37 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:14:37 user nova-compute[73144]:   </features>
Aug 14 22:14:37 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:14:37 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:14:37 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:14:37 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:14:37 user nova-compute[73144]:   </clock>
Aug 14 22:14:37 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:14:37 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:14:37 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:14:37 user nova-compute[73144]:   </cpu>
Aug 14 22:14:37 user nova-compute[73144]:   <devices>
Aug 14 22:14:37 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:14:37 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:14:37 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk"/>
Aug 14 22:14:37 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:14:37 user nova-compute[73144]:     </disk>
Aug 14 22:14:37 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:14:37 user nova-compute[73144]:       <mac address="fa:16:3e:e5:7b:e9"/>
Aug 14 22:14:37 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:14:37 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:14:37 user nova-compute[73144]:       <target dev="tapa6fdc5cf-91"/>
Aug 14 22:14:37 user nova-compute[73144]:     </interface>
Aug 14 22:14:37 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:14:37 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/console.log" append="off"/>
Aug 14 22:14:37 user nova-compute[73144]:     </serial>
Aug 14 22:14:37 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:14:37 user nova-compute[73144]:     <video>
Aug 14 22:14:37 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:14:37 user nova-compute[73144]:     </video>
Aug 14 22:14:37 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:14:37 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:14:37 user nova-compute[73144]:     </rng>
Aug 14 22:14:37 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:14:37 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:14:37 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:14:37 user nova-compute[73144]:     </memballoon>
Aug 14 22:14:37 user nova-compute[73144]:   </devices>
Aug 14 22:14:37 user nova-compute[73144]: </domain>
Aug 14 22:14:37 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1902301298',display_name='tempest-VolumesSnapshotTestJSON-instance-1902301298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1902301298',id=49,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwZUGxkBH3OB5HhSfBTkCf3XzsV+kyIQhsmIACOp5O9vEWBDKoiHr8BUxWMTPBO58ZPZ2IoQfvRmSz3b2Ru7LhgvfTrFBR20splBdMKEUcWu0Euqy5ctRwFKmyNrPiA6A==',key_name='tempest-keypair-1316694006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33768265e13b425c9338be4ed4242a29',ramdisk_id='',reservation_id='r-1j31nm9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1006768833',owner_user_name='tempest-VolumesSnapshotTestJSON-1006768833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25e50ade908b447aaeb5dac6a9bb33af',uuid=c0d17b12-3516-4e9d-9fe1-87cc7e99a249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converting VIF {"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7b:e9,bridge_name='br-int',has_traffic_filtering=True,id=a6fdc5cf-91d6-466f-a2af-0f294d96da01,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6fdc5cf-91') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG os_vif [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7b:e9,bridge_name='br-int',has_traffic_filtering=True,id=a6fdc5cf-91d6-466f-a2af-0f294d96da01,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6fdc5cf-91') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6fdc5cf-91, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6fdc5cf-91, col_values=(('external_ids', {'iface-id': 'a6fdc5cf-91d6-466f-a2af-0f294d96da01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:7b:e9', 'vm-uuid': 'c0d17b12-3516-4e9d-9fe1-87cc7e99a249'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:37 user nova-compute[73144]: INFO os_vif [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7b:e9,bridge_name='br-int',has_traffic_filtering=True,id=a6fdc5cf-91d6-466f-a2af-0f294d96da01,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6fdc5cf-91')
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:14:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No VIF found with MAC fa:16:3e:e5:7b:e9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updated VIF entry in instance network info cache for port a6fdc5cf-91d6-466f-a2af-0f294d96da01. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating instance_info_cache with network_info: [{"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-6e825e5f-78d9-49ee-8a01-6b3bb31a7ba2 req-7dbfe753-8601-4e8f-9ef9-f838185f66bb service nova] Releasing lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-changed-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG nova.compute.manager [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Refreshing instance network info cache due to event network-changed-22591a2b-58b9-4518-9958-2cdcd91c7948. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] Acquiring lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] Acquired lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:14:38 user nova-compute[73144]: DEBUG nova.network.neutron [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Refreshing network info cache for port 22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:39 user nova-compute[73144]: INFO nova.compute.manager [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Terminating instance
Aug 14 22:14:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-94b50791-1c3e-4b51-b358-b142211ad918 req-aa0ea2d7-4485-420d-bafa-0ddc6efdb41a service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94b50791-1c3e-4b51-b358-b142211ad918 req-aa0ea2d7-4485-420d-bafa-0ddc6efdb41a service nova] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94b50791-1c3e-4b51-b358-b142211ad918 req-aa0ea2d7-4485-420d-bafa-0ddc6efdb41a service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-94b50791-1c3e-4b51-b358-b142211ad918 req-aa0ea2d7-4485-420d-bafa-0ddc6efdb41a service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-94b50791-1c3e-4b51-b358-b142211ad918 req-aa0ea2d7-4485-420d-bafa-0ddc6efdb41a service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] No waiting events found dispatching network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:14:39 user nova-compute[73144]: WARNING nova.compute.manager [req-94b50791-1c3e-4b51-b358-b142211ad918 req-aa0ea2d7-4485-420d-bafa-0ddc6efdb41a service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received unexpected event network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 for instance with vm_state building and task_state spawning.
Aug 14 22:14:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updated VIF entry in instance network info cache for port 22591a2b-58b9-4518-9958-2cdcd91c7948. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updating instance_info_cache with network_info: [{"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-43b2072d-e50e-4278-9aca-13609eb7ec2e req-2ec15dd2-eb09-4840-9748-1a1174ea0ea9 service nova] Releasing lock "refresh_cache-a4b4426c-82ae-4b99-81aa-4d920d4b6fac" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Instance destroyed successfully.
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'resources' on Instance uuid a4b4426c-82ae-4b99-81aa-4d920d4b6fac {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1311828864',display_name='tempest-TestVolumeBootPattern-server-1311828864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1311828864',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:13:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-dfll6tdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:13:02Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=a4b4426c-82ae-4b99-81aa-4d920d4b6fac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "22591a2b-58b9-4518-9958-2cdcd91c7948", "address": "fa:16:3e:97:a2:df", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22591a2b-58", "ovs_interfaceid": "22591a2b-58b9-4518-9958-2cdcd91c7948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:a2:df,bridge_name='br-int',has_traffic_filtering=True,id=22591a2b-58b9-4518-9958-2cdcd91c7948,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22591a2b-58') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_vif [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a2:df,bridge_name='br-int',has_traffic_filtering=True,id=22591a2b-58b9-4518-9958-2cdcd91c7948,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22591a2b-58') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22591a2b-58, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:14:40 user nova-compute[73144]: INFO os_vif [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a2:df,bridge_name='br-int',has_traffic_filtering=True,id=22591a2b-58b9-4518-9958-2cdcd91c7948,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22591a2b-58')
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:14:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e37902-b64d-41af-83a0-e720a6ad99d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de861e82-2b86-4439-a6e3-c70e0e6bde72]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:14:40 user nova-compute[73144]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:14:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:14:40 user nova-compute[73144]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:14:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586c27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddda53f-0e95-43c7-855e-8313ab90d51f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c684665b-aa11-4afc-b773-f1a6251b0d7a]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb2ffa1-d381-4fc9-8abb-7593958f723f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e0ad7-4ab7-4615-b080-82efea49e220]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8569477f-b744-4f02-95c5-f0d1bd0fc353]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e395bc-c737-4f04-80fa-9dce646c2bf2]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]
Aug 14 22:14:40 user nova-compute[73144]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.
Aug 14 22:14:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[db288dd7-b2b2-435d-8e2c-4c2907eb1212]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== disconnect_volume: return (315ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:14:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Deleting instance files /opt/stack/data/nova/instances/a4b4426c-82ae-4b99-81aa-4d920d4b6fac_del
Aug 14 22:14:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Deletion of /opt/stack/data/nova/instances/a4b4426c-82ae-4b99-81aa-4d920d4b6fac_del complete
Aug 14 22:14:40 user nova-compute[73144]: INFO nova.compute.manager [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 14 22:14:40 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:14:40 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051281.6521137, c0d17b12-3516-4e9d-9fe1-87cc7e99a249 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] VM Resumed (Lifecycle Event)
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Instance spawned successfully.
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] No waiting events found dispatching network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:14:41 user nova-compute[73144]: WARNING nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received unexpected event network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 for instance with vm_state building and task_state spawning.
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-vif-unplugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Acquiring lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] No waiting events found dispatching network-vif-unplugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-vif-unplugged-22591a2b-58b9-4518-9958-2cdcd91c7948 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Acquiring lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] No waiting events found dispatching network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:14:41 user nova-compute[73144]: WARNING nova.compute.manager [req-0070c95e-7995-4071-9b3a-6b121f308fde req-a13c8441-603c-4e75-ab9a-bb28c67ab4df service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received unexpected event network-vif-plugged-22591a2b-58b9-4518-9958-2cdcd91c7948 for instance with vm_state active and task_state deleting.
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051281.654148, c0d17b12-3516-4e9d-9fe1-87cc7e99a249 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] VM Started (Lifecycle Event)
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Took 1.02 seconds to deallocate network for instance.
Aug 14 22:14:41 user nova-compute[73144]: DEBUG nova.compute.manager [req-c7023913-2903-4c5a-b98e-64cf37bcf7e9 req-32c96ec4-5415-424e-b89d-9ab70fe00ec6 service nova] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Received event network-vif-deleted-22591a2b-58b9-4518-9958-2cdcd91c7948 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:14:41 user nova-compute[73144]: INFO nova.compute.manager [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Took 6.47 seconds to build instance.
Aug 14 22:14:41 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-edd02d1b-beb2-4920-a209-c36307e84d6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.601s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:42 user nova-compute[73144]: INFO nova.compute.manager [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Took 0.81 seconds to detach 1 volumes for instance.
Aug 14 22:14:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:14:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:14:42 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051267.7641914, 9e9d6b63-cc96-431f-ab2f-733809ffdcb3 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:14:42 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] VM Stopped (Lifecycle Event)
Aug 14 22:14:42 user nova-compute[73144]: DEBUG nova.compute.manager [None req-006369ca-df9f-4342-a838-23a2019a7a75 None None] [instance: 9e9d6b63-cc96-431f-ab2f-733809ffdcb3] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:14:42 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:14:42 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:14:42 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:42 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Deleted allocations for instance a4b4426c-82ae-4b99-81aa-4d920d4b6fac
Aug 14 22:14:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4a68857e-b1f8-4728-a6c7-9cc55c81e65b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "a4b4426c-82ae-4b99-81aa-4d920d4b6fac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.473s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:14:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:14:55 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051280.371156, a4b4426c-82ae-4b99-81aa-4d920d4b6fac => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:14:55 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] VM Stopped (Lifecycle Event)
Aug 14 22:14:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b9d1520d-d5c3-43ad-9746-28fd170be378 None None] [instance: a4b4426c-82ae-4b99-81aa-4d920d4b6fac] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:14:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:14:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:15:11 user nova-compute[73144]: DEBUG nova.compute.manager [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing instance network info cache due to event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:15:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:15:11 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:15:11 user nova-compute[73144]: DEBUG nova.network.neutron [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updated VIF entry in instance network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG nova.network.neutron [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cdda177b-c072-4908-b11d-f86d3d658c00 req-7fff05a5-4344-426f-84ca-e4f8c1a3d9bc service nova] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:12 user nova-compute[73144]: INFO nova.compute.manager [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Shelve offloading
Aug 14 22:15:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-e390d162-2bad-4b60-ad66-6dfec49ead40 req-ce5ec398-e118-4ca1-a396-e4fe586286da service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-unplugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e390d162-2bad-4b60-ad66-6dfec49ead40 req-ce5ec398-e118-4ca1-a396-e4fe586286da service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e390d162-2bad-4b60-ad66-6dfec49ead40 req-ce5ec398-e118-4ca1-a396-e4fe586286da service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e390d162-2bad-4b60-ad66-6dfec49ead40 req-ce5ec398-e118-4ca1-a396-e4fe586286da service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-e390d162-2bad-4b60-ad66-6dfec49ead40 req-ce5ec398-e118-4ca1-a396-e4fe586286da service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-unplugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:15:12 user nova-compute[73144]: WARNING nova.compute.manager [req-e390d162-2bad-4b60-ad66-6dfec49ead40 req-ce5ec398-e118-4ca1-a396-e4fe586286da service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received unexpected event network-vif-unplugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with vm_state active and task_state shelving.
Aug 14 22:15:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance destroyed successfully.
Aug 14 22:15:13 user nova-compute[73144]: DEBUG nova.compute.manager [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:15:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:15:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:15:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:15:13 user nova-compute[73144]: DEBUG nova.network.neutron [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:15:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:15:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance destroyed successfully.
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.objects.instance [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'resources' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1582032628',display_name='tempest-TestShelveInstance-server-1582032628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1582032628',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyjogbPWdMjyrXe3p70Vul0z43jN2t4FRLtvhfLhpoiAv+aTDsfm7ezczVgMwRuRjvbdVAI9pYKMA6a2GIU3QB/32e1FH53z+NlI1u6N3rDgRaRP7/tSZGvHrQtzg81kw==',key_name='tempest-TestShelveInstance-1810898075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6cd8e6173bf4dc38aa9f99c854f5df4',ramdisk_id='',reservation_id='r-yx9lj9r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754427089',owner_user_name='tempest-TestShelveInstance-1754427089-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:13:35Z,user_data=None,user_id='53ae193a68f448e18a778310ae8ecc04',uuid=57f47674-a3c4-44d9-8b02-0b3bdeae5c62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converting VIF {"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_vif [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb792bbc1-99, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:15:14 user nova-compute[73144]: INFO os_vif [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99')
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:15:14 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing instance network info cache due to event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d21b1cd-7c5b-43a6-ab7b-9e5124ae601c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[92760d87-a75d-47d3-959c-1c9ab961d949]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:15:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:15:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1586a8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef841658-2bf4-48b9-822a-389b7fa8a442]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222a751-a180-4ee0-9c01-3131d6994029]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06abe2a-1b2a-4107-9400-137deb624f08]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee33933-3fca-4a19-9c6d-1ae0bbc5bd74]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[91580d99-e7e8-4e10-884d-2d0d50f9946e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a307797-0886-4f91-989b-a005c9103285]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]
Aug 14 22:15:14 user nova-compute[73144]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.
Aug 14 22:15:14 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[283c70ee-4a56-4e90-a563-7bee893906ce]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] <== disconnect_volume: return (266ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:15:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Deleting instance files /opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62_del
Aug 14 22:15:14 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Deletion of /opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62_del complete
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-d44231d9-f528-46de-8f3e-916cbf3a7b74 req-27e5b7d0-cd5a-4be0-bcd2-c87311518efb service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d44231d9-f528-46de-8f3e-916cbf3a7b74 req-27e5b7d0-cd5a-4be0-bcd2-c87311518efb service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d44231d9-f528-46de-8f3e-916cbf3a7b74 req-27e5b7d0-cd5a-4be0-bcd2-c87311518efb service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d44231d9-f528-46de-8f3e-916cbf3a7b74 req-27e5b7d0-cd5a-4be0-bcd2-c87311518efb service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-d44231d9-f528-46de-8f3e-916cbf3a7b74 req-27e5b7d0-cd5a-4be0-bcd2-c87311518efb service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:15:14 user nova-compute[73144]: WARNING nova.compute.manager [req-d44231d9-f528-46de-8f3e-916cbf3a7b74 req-27e5b7d0-cd5a-4be0-bcd2-c87311518efb service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received unexpected event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with vm_state active and task_state shelving.
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updated VIF entry in instance network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:15:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": null, "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb792bbc1-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:15:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-322f24de-d9d2-408c-8756-362060c52891 req-741f4da3-cc1b-47bf-91e8-fccf422fdf7d service nova] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:15:15 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:15:15 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Deleted allocations for instance 57f47674-a3c4-44d9-8b02-0b3bdeae5c62
Aug 14 22:15:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'numa_topology' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:15:16 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:15:16 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:15:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-62c5095e-e81e-45e7-965d-361e05c43be9 tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.614s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:15:20 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:15:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=25.126243591308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:15:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:24 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:15:26 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:15:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:15:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:15:26 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:15:26 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:15:27 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating instance_info_cache with network_info: [{"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:15:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:15:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:15:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:28 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051313.2893019, 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:15:28 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] VM Stopped (Lifecycle Event)
Aug 14 22:15:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f2d24c6b-6d49-4d2b-9a2a-3153b35426b8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:15:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "cc85ca71-e7ac-4790-83b2-0887c3cab074" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:15:31 user nova-compute[73144]: INFO nova.compute.claims [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Claim successful on node user
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.network.neutron [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:15:31 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:15:31 user nova-compute[73144]: INFO nova.virt.block_device [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Booting with volume 078af43c-80ec-4edd-836f-657c7718a7ff at /dev/vda
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.policy [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a3e93f724b43a08ee42b79c63ed4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f796a65843b467a9889f47789c87eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG os_brick.utils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e628cf44-5bbb-467a-8d32-f06f9e7d1fb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf618e-ca47-4c28-ab1b-11f61ef2d178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bbab24-4a8e-42ed-b593-09bd60bc174e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d343cce-41fa-4031-b341-d565d8266356]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:15:31 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:15:31 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c27e1b-3dab-4897-a01e-604ac7277801]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG os_brick.utils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:15:31 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating existing volume attachment record: ff0b66b3-aee7-41ed-a476-7a8318d5b882 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:15:32 user nova-compute[73144]: DEBUG nova.network.neutron [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Successfully created port: e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Successfully updated port: e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquired lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-changed-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Refreshing instance network info cache due to event network-changed-e8affea4-0e1c-461e-a393-79501753bd30. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] Acquiring lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.network.neutron [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating instance_info_cache with network_info: [{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Releasing lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Instance network_info: |[{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] Acquired lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:15:33 user nova-compute[73144]: DEBUG nova.network.neutron [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Refreshing network info cache for port e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updated VIF entry in instance network info cache for port e8affea4-0e1c-461e-a393-79501753bd30. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG nova.network.neutron [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating instance_info_cache with network_info: [{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-867cb57c-c471-441b-aede-ad484d4bb27f req-20570e00-93fc-4bb8-a7cf-eed527dbbce1 service nova] Releasing lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:15:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:35 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:15:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:15:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:15:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:15:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:15:39 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:15:40 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Creating image(s)
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Ensure instance console log exists: /opt/stack/data/nova/instances/cc85ca71-e7ac-4790-83b2-0887c3cab074/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Start _get_guest_xml network_info=[{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'ff0b66b3-aee7-41ed-a476-7a8318d5b882', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc85ca71-e7ac-4790-83b2-0887c3cab074', 'attached_at': '', 'detached_at': '', 'volume_id': '078af43c-80ec-4edd-836f-657c7718a7ff', 'serial': '078af43c-80ec-4edd-836f-657c7718a7ff'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:15:40 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:15:40 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:15:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:15:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:15:40 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cf2de7-bea1-4700-9a03-db97641dd84c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:15:40 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588a393-9161-4aad-a3ea-9bb28f05e32c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff] added
Aug 14 22:15:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda38a7c-223f-429c-816c-4dbe6b099680]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[146667e1-bb95-4dfa-b4b3-d6ffc09444e2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSGgPmyr {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSGgPmyr" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f8c13e-2935-4af4-b8bc-21f435416362]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jSGgPmyr'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d97b4bd-aa41-4329-b26d-53ea6587b3dc]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f4cb7-d514-40d7-8ebc-48529aaf9fdd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 22:15:40 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 22:15:40 user nova-compute[73144]:  {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:15:40 user nova-compute[73144]: WARNING os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 22:15:40 user nova-compute[73144]: 
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdbc428-a6b0-4432-b837-de4b49ce6ecf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]
Aug 14 22:15:40 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.
Aug 14 22:15:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea7055-079a-41a4-a8ec-e88af930d4f4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d23df6-d873-44fe-90e5-8171aa265d4a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:15:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:15:40 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff2942-f076-4269-88ab-49ad1b2b7adf]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:15:40 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26333326436633965', 'path': '/dev/sdb'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333326436633965', 'path': '/dev/sdb'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-9538474',display_name='tempest-TestVolumeBootPattern-server-9538474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-9538474',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-tarjcf2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:15:32Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=cc85ca71-e7ac-4790-83b2-0887c3cab074,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:61:f4,bridge_name='br-int',has_traffic_filtering=True,id=e8affea4-0e1c-461e-a393-79501753bd30,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8affea4-0e') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.objects.instance [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'pci_devices' on Instance uuid cc85ca71-e7ac-4790-83b2-0887c3cab074 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:15:41 user nova-compute[73144]:   <uuid>cc85ca71-e7ac-4790-83b2-0887c3cab074</uuid>
Aug 14 22:15:41 user nova-compute[73144]:   <name>instance-00000032</name>
Aug 14 22:15:41 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:15:41 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:15:41 user nova-compute[73144]:   <metadata>
Aug 14 22:15:41 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:15:41 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:15:41 user nova-compute[73144]:       <nova:name>tempest-TestVolumeBootPattern-server-9538474</nova:name>
Aug 14 22:15:41 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:15:40</nova:creationTime>
Aug 14 22:15:41 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:15:41 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:15:41 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:15:41 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:15:41 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:15:41 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:15:41 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:15:41 user nova-compute[73144]:       <nova:owner>
Aug 14 22:15:41 user nova-compute[73144]:         <nova:user uuid="52a3e93f724b43a08ee42b79c63ed4d0">tempest-TestVolumeBootPattern-790116957-project-member</nova:user>
Aug 14 22:15:41 user nova-compute[73144]:         <nova:project uuid="0f796a65843b467a9889f47789c87eed">tempest-TestVolumeBootPattern-790116957</nova:project>
Aug 14 22:15:41 user nova-compute[73144]:       </nova:owner>
Aug 14 22:15:41 user nova-compute[73144]:       <nova:ports>
Aug 14 22:15:41 user nova-compute[73144]:         <nova:port uuid="e8affea4-0e1c-461e-a393-79501753bd30">
Aug 14 22:15:41 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 22:15:41 user nova-compute[73144]:         </nova:port>
Aug 14 22:15:41 user nova-compute[73144]:       </nova:ports>
Aug 14 22:15:41 user nova-compute[73144]:     </nova:instance>
Aug 14 22:15:41 user nova-compute[73144]:   </metadata>
Aug 14 22:15:41 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:15:41 user nova-compute[73144]:     <system>
Aug 14 22:15:41 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:15:41 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:15:41 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:15:41 user nova-compute[73144]:       <entry name="serial">cc85ca71-e7ac-4790-83b2-0887c3cab074</entry>
Aug 14 22:15:41 user nova-compute[73144]:       <entry name="uuid">cc85ca71-e7ac-4790-83b2-0887c3cab074</entry>
Aug 14 22:15:41 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:15:41 user nova-compute[73144]:     </system>
Aug 14 22:15:41 user nova-compute[73144]:   </sysinfo>
Aug 14 22:15:41 user nova-compute[73144]:   <os>
Aug 14 22:15:41 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:15:41 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:15:41 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:15:41 user nova-compute[73144]:   </os>
Aug 14 22:15:41 user nova-compute[73144]:   <features>
Aug 14 22:15:41 user nova-compute[73144]:     <acpi/>
Aug 14 22:15:41 user nova-compute[73144]:     <apic/>
Aug 14 22:15:41 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:15:41 user nova-compute[73144]:   </features>
Aug 14 22:15:41 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:15:41 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:15:41 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:15:41 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:15:41 user nova-compute[73144]:   </clock>
Aug 14 22:15:41 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:15:41 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:15:41 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:15:41 user nova-compute[73144]:   </cpu>
Aug 14 22:15:41 user nova-compute[73144]:   <devices>
Aug 14 22:15:41 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:15:41 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:15:41 user nova-compute[73144]:       <source dev="/dev/sdb"/>
Aug 14 22:15:41 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:15:41 user nova-compute[73144]:       <serial>078af43c-80ec-4edd-836f-657c7718a7ff</serial>
Aug 14 22:15:41 user nova-compute[73144]:     </disk>
Aug 14 22:15:41 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:15:41 user nova-compute[73144]:       <mac address="fa:16:3e:d1:61:f4"/>
Aug 14 22:15:41 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:15:41 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:15:41 user nova-compute[73144]:       <target dev="tape8affea4-0e"/>
Aug 14 22:15:41 user nova-compute[73144]:     </interface>
Aug 14 22:15:41 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:15:41 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/cc85ca71-e7ac-4790-83b2-0887c3cab074/console.log" append="off"/>
Aug 14 22:15:41 user nova-compute[73144]:     </serial>
Aug 14 22:15:41 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:15:41 user nova-compute[73144]:     <video>
Aug 14 22:15:41 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:15:41 user nova-compute[73144]:     </video>
Aug 14 22:15:41 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:15:41 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:15:41 user nova-compute[73144]:     </rng>
Aug 14 22:15:41 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:15:41 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:15:41 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:15:41 user nova-compute[73144]:     </memballoon>
Aug 14 22:15:41 user nova-compute[73144]:   </devices>
Aug 14 22:15:41 user nova-compute[73144]: </domain>
Aug 14 22:15:41 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-9538474',display_name='tempest-TestVolumeBootPattern-server-9538474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-9538474',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-tarjcf2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:15:32Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=cc85ca71-e7ac-4790-83b2-0887c3cab074,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:61:f4,bridge_name='br-int',has_traffic_filtering=True,id=e8affea4-0e1c-461e-a393-79501753bd30,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8affea4-0e') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG os_vif [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:61:f4,bridge_name='br-int',has_traffic_filtering=True,id=e8affea4-0e1c-461e-a393-79501753bd30,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8affea4-0e') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8affea4-0e, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8affea4-0e, col_values=(('external_ids', {'iface-id': 'e8affea4-0e1c-461e-a393-79501753bd30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:61:f4', 'vm-uuid': 'cc85ca71-e7ac-4790-83b2-0887c3cab074'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:15:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:41 user nova-compute[73144]: INFO os_vif [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:61:f4,bridge_name='br-int',has_traffic_filtering=True,id=e8affea4-0e1c-461e-a393-79501753bd30,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8affea4-0e')
Aug 14 22:15:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:15:42 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No VIF found with MAC fa:16:3e:d1:61:f4, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f496dd6-04c0-4932-9e1c-974923152212 req-363e82c1-aede-47ee-9d38-9f11f0f71a53 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3f496dd6-04c0-4932-9e1c-974923152212 req-363e82c1-aede-47ee-9d38-9f11f0f71a53 service nova] Acquiring lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3f496dd6-04c0-4932-9e1c-974923152212 req-363e82c1-aede-47ee-9d38-9f11f0f71a53 service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3f496dd6-04c0-4932-9e1c-974923152212 req-363e82c1-aede-47ee-9d38-9f11f0f71a53 service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f496dd6-04c0-4932-9e1c-974923152212 req-363e82c1-aede-47ee-9d38-9f11f0f71a53 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] No waiting events found dispatching network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:15:43 user nova-compute[73144]: WARNING nova.compute.manager [req-3f496dd6-04c0-4932-9e1c-974923152212 req-363e82c1-aede-47ee-9d38-9f11f0f71a53 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received unexpected event network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 for instance with vm_state building and task_state spawning.
Aug 14 22:15:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:43 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051345.4075139, cc85ca71-e7ac-4790-83b2-0887c3cab074 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:15:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] VM Resumed (Lifecycle Event)
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:15:45 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Instance spawned successfully.
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:15:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051345.4088955, cc85ca71-e7ac-4790-83b2-0887c3cab074 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:15:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] VM Started (Lifecycle Event)
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:15:45 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:15:45 user nova-compute[73144]: INFO nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [req-c062435a-59fc-41cd-9b39-35b52f5b3e1e req-257ef3ba-4490-4370-9bea-7736d07c216d service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c062435a-59fc-41cd-9b39-35b52f5b3e1e req-257ef3ba-4490-4370-9bea-7736d07c216d service nova] Acquiring lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c062435a-59fc-41cd-9b39-35b52f5b3e1e req-257ef3ba-4490-4370-9bea-7736d07c216d service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-c062435a-59fc-41cd-9b39-35b52f5b3e1e req-257ef3ba-4490-4370-9bea-7736d07c216d service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:45 user nova-compute[73144]: DEBUG nova.compute.manager [req-c062435a-59fc-41cd-9b39-35b52f5b3e1e req-257ef3ba-4490-4370-9bea-7736d07c216d service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] No waiting events found dispatching network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:15:45 user nova-compute[73144]: WARNING nova.compute.manager [req-c062435a-59fc-41cd-9b39-35b52f5b3e1e req-257ef3ba-4490-4370-9bea-7736d07c216d service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received unexpected event network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 for instance with vm_state building and task_state spawning.
Aug 14 22:15:45 user nova-compute[73144]: INFO nova.compute.manager [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Took 14.22 seconds to build instance.
Aug 14 22:15:45 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-86b18719-31fd-4d6a-b6fa-6ef5ea1e0b21 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.312s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:15:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:51 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:15:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:15:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:15:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:15:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:15:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:15:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:17 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:17 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:16:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:20 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:16:21 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:16:21 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=25.11444091796875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cc85ca71-e7ac-4790-83b2-0887c3cab074 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 22:16:21 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 22:16:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:22 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:16:22 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:16:22 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:16:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:16:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:25 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-changed-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:16:26 user nova-compute[73144]: DEBUG nova.compute.manager [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Refreshing instance network info cache due to event network-changed-a6fdc5cf-91d6-466f-a2af-0f294d96da01. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:16:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] Acquiring lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:16:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] Acquired lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:16:26 user nova-compute[73144]: DEBUG nova.network.neutron [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Refreshing network info cache for port a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG nova.network.neutron [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updated VIF entry in instance network info cache for port a6fdc5cf-91d6-466f-a2af-0f294d96da01. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG nova.network.neutron [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating instance_info_cache with network_info: [{"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a85c3c98-5d8e-46dc-972f-b27499682e29 req-3f017641-2497-48fd-a2b5-7d94e78eec30 service nova] Releasing lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:16:27 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'flavor' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:16:27 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Ignoring supplied device name: /dev/vdb
Aug 14 22:16:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:16:28 user nova-compute[73144]: INFO nova.compute.manager [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Attaching volume fca07579-9b87-4681-9432-c22590a9df0a to /dev/vdb
Aug 14 22:16:28 user nova-compute[73144]: DEBUG os_brick.utils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bd0405-e2b8-4c4c-a009-ec654c3e0fc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating instance_info_cache with network_info: [{"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-c0d17b12-3516-4e9d-9fe1-87cc7e99a249" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e1923-8cd3-4787-9d1a-539d1208147e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e34b1f-9992-407e-88b7-0baf3930fe7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52748dbb-4b33-43b4-8c1f-cc010651103d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:16:28 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:16:28 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[44439f24-174d-4c0c-9452-f7b7bc91d7f3]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG os_brick.utils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:16:28 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating existing volume attachment record: d86196d1-e27d-433f-a3e0-d4e628d6033c {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:16:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:16:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 22:16:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 22:16:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwqRhgnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:16:37 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:16:37 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:16:37 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc7f3f4-5a81-4c0a-856e-32b45e8fc8fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:16:37 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[53da646e-1ccc-4195-90db-c521b7a5b39b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a] added
Aug 14 22:16:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bf2bc5-2e38-4f81-9d1d-72e5a0ced83a]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3457cba-dafb-4fa8-8457-bd4d81133f5d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwqRhgnP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwqRhgnP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1146d0-7a9b-458b-a284-ea2cd4adf27c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwqRhgnP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8428a0b3-2ac9-47d6-8fdb-c786de2d4050]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04bd36d-b054-4ced-9a36-1ce7312111c3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:16:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:16:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e0b9f-f8e5-4a79-8686-ef2be0541a73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260]
Aug 14 22:16:37 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260] successful.
Aug 14 22:16:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[04744486-8d07-4556-bdb4-c935e2ca495e]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9eaa2f-7cc3-4d05-bcb2-d5b47e15f3d6]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:16:37 user nova-compute[73144]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a (non-flash)
Aug 14 22:16:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:16:37 user nova-compute[73144]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a (non-flash)
Aug 14 22:16:37 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac61d3d8-f3e6-4019-b932-94c23afda714]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:16:37 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:16:38 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:16:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwqRhgnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:16:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:16:38 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26435643064366432', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:16:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435643064366432', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:16:38 user nova-compute[73144]: DEBUG nova.objects.instance [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'flavor' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:16:38 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:16:38 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:16:38 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 22:16:38 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:16:38 user nova-compute[73144]:   <serial>fca07579-9b87-4681-9432-c22590a9df0a</serial>
Aug 14 22:16:38 user nova-compute[73144]: </disk>
Aug 14 22:16:38 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:16:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:16:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:16:39 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] No VIF found with MAC fa:16:3e:e5:7b:e9, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:16:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-0834057a-01cb-4c94-9ca3-7cabe81225a9 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.031s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:16:41 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:46 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:53 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:16:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:16:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:16:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:16:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:16:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:16:59 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:16:59 user nova-compute[73144]: INFO nova.compute.claims [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Claim successful on node user
Aug 14 22:16:59 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:16:59 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:17:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.policy [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9798a44901ed49b592851aa91f15de1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a97840b7634f8d96887fd9ace7c80e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:17:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Creating image(s)
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "/opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "/opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.180s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk 1073741824 {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9,backing_fmt=raw /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk 1073741824" returned: 0 in 0.050s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "a36c4e90e60aaf420d41b29299ad8df91fccb3a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9 --force-share --output=json" returned: 0 in 0.179s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk. size=1073741824 {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:00 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Successfully created port: 13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.virt.disk.api [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Cannot resize image /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk to a smaller size. {{(pid=73144) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'migration_context' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Created local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Ensure instance console log exists: /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Successfully updated port: 13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquired lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-changed-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Refreshing instance network info cache due to event network-changed-13ecf857-d666-4057-8c33-9479a275b130. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] Acquiring lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:01 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.neutron [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updating instance_info_cache with network_info: [{"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Releasing lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Instance network_info: |[{"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] Acquired lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Refreshing network info cache for port 13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Start _get_guest_xml network_info=[{"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '53539290-1600-4e84-8f24-496f41396a43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:17:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:02 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T21:41:17Z,direct_url=<?>,disk_format='qcow2',id=53539290-1600-4e84-8f24-496f41396a43,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c8de138933604706be0b674829ad5577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T21:41:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-90100856',display_name='tempest-TestServerVolumeAttachmentScenario-server-90100856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-90100856',id=51,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKV00mjwiTZCY2BedIsJm8vxuE3OkVeIwI0NVFdFSiUzqJnuIqckFPNwO5JvR18rxFQ9uCoJofdl12SmeYI/iRJlH/Qup2v6VpguQnl/35AP8xQzjFaXYH7FbKFUEu0OA==',key_name='tempest-keypair-557299368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73a97840b7634f8d96887fd9ace7c80e',ramdisk_id='',reservation_id='r-gtq5wes9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-535491581',owner_user_name='tempest-TestServerVolumeAttachmentScenario-535491581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9798a44901ed49b592851aa91f15de1b',uuid=9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Converting VIF {"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:62:da,bridge_name='br-int',has_traffic_filtering=True,id=13ecf857-d666-4057-8c33-9479a275b130,network=Network(f961ab13-f798-4dec-a64f-b7eed3145036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ecf857-d6') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:17:02 user nova-compute[73144]:   <uuid>9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984</uuid>
Aug 14 22:17:02 user nova-compute[73144]:   <name>instance-00000033</name>
Aug 14 22:17:02 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:17:02 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:17:02 user nova-compute[73144]:   <metadata>
Aug 14 22:17:02 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:17:02 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:17:02 user nova-compute[73144]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-90100856</nova:name>
Aug 14 22:17:02 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:17:02</nova:creationTime>
Aug 14 22:17:02 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:17:02 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:17:02 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:17:02 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:17:02 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:17:02 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:17:02 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:17:02 user nova-compute[73144]:       <nova:owner>
Aug 14 22:17:02 user nova-compute[73144]:         <nova:user uuid="9798a44901ed49b592851aa91f15de1b">tempest-TestServerVolumeAttachmentScenario-535491581-project-member</nova:user>
Aug 14 22:17:02 user nova-compute[73144]:         <nova:project uuid="73a97840b7634f8d96887fd9ace7c80e">tempest-TestServerVolumeAttachmentScenario-535491581</nova:project>
Aug 14 22:17:02 user nova-compute[73144]:       </nova:owner>
Aug 14 22:17:02 user nova-compute[73144]:       <nova:root type="image" uuid="53539290-1600-4e84-8f24-496f41396a43"/>
Aug 14 22:17:02 user nova-compute[73144]:       <nova:ports>
Aug 14 22:17:02 user nova-compute[73144]:         <nova:port uuid="13ecf857-d666-4057-8c33-9479a275b130">
Aug 14 22:17:02 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 22:17:02 user nova-compute[73144]:         </nova:port>
Aug 14 22:17:02 user nova-compute[73144]:       </nova:ports>
Aug 14 22:17:02 user nova-compute[73144]:     </nova:instance>
Aug 14 22:17:02 user nova-compute[73144]:   </metadata>
Aug 14 22:17:02 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:17:02 user nova-compute[73144]:     <system>
Aug 14 22:17:02 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:17:02 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:17:02 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:17:02 user nova-compute[73144]:       <entry name="serial">9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984</entry>
Aug 14 22:17:02 user nova-compute[73144]:       <entry name="uuid">9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984</entry>
Aug 14 22:17:02 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:17:02 user nova-compute[73144]:     </system>
Aug 14 22:17:02 user nova-compute[73144]:   </sysinfo>
Aug 14 22:17:02 user nova-compute[73144]:   <os>
Aug 14 22:17:02 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:17:02 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:17:02 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:17:02 user nova-compute[73144]:   </os>
Aug 14 22:17:02 user nova-compute[73144]:   <features>
Aug 14 22:17:02 user nova-compute[73144]:     <acpi/>
Aug 14 22:17:02 user nova-compute[73144]:     <apic/>
Aug 14 22:17:02 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:17:02 user nova-compute[73144]:   </features>
Aug 14 22:17:02 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:17:02 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:17:02 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:17:02 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:17:02 user nova-compute[73144]:   </clock>
Aug 14 22:17:02 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:17:02 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:17:02 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:17:02 user nova-compute[73144]:   </cpu>
Aug 14 22:17:02 user nova-compute[73144]:   <devices>
Aug 14 22:17:02 user nova-compute[73144]:     <disk type="file" device="disk">
Aug 14 22:17:02 user nova-compute[73144]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:17:02 user nova-compute[73144]:       <source file="/opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk"/>
Aug 14 22:17:02 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:17:02 user nova-compute[73144]:     </disk>
Aug 14 22:17:02 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:17:02 user nova-compute[73144]:       <mac address="fa:16:3e:96:62:da"/>
Aug 14 22:17:02 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:17:02 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:17:02 user nova-compute[73144]:       <target dev="tap13ecf857-d6"/>
Aug 14 22:17:02 user nova-compute[73144]:     </interface>
Aug 14 22:17:02 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:17:02 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/console.log" append="off"/>
Aug 14 22:17:02 user nova-compute[73144]:     </serial>
Aug 14 22:17:02 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:17:02 user nova-compute[73144]:     <video>
Aug 14 22:17:02 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:17:02 user nova-compute[73144]:     </video>
Aug 14 22:17:02 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:17:02 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:17:02 user nova-compute[73144]:     </rng>
Aug 14 22:17:02 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:17:02 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:17:02 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:17:02 user nova-compute[73144]:     </memballoon>
Aug 14 22:17:02 user nova-compute[73144]:   </devices>
Aug 14 22:17:02 user nova-compute[73144]: </domain>
Aug 14 22:17:02 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-90100856',display_name='tempest-TestServerVolumeAttachmentScenario-server-90100856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-90100856',id=51,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKV00mjwiTZCY2BedIsJm8vxuE3OkVeIwI0NVFdFSiUzqJnuIqckFPNwO5JvR18rxFQ9uCoJofdl12SmeYI/iRJlH/Qup2v6VpguQnl/35AP8xQzjFaXYH7FbKFUEu0OA==',key_name='tempest-keypair-557299368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73a97840b7634f8d96887fd9ace7c80e',ramdisk_id='',reservation_id='r-gtq5wes9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-535491581',owner_user_name='tempest-TestServerVolumeAttachmentScenario-535491581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9798a44901ed49b592851aa91f15de1b',uuid=9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Converting VIF {"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:62:da,bridge_name='br-int',has_traffic_filtering=True,id=13ecf857-d666-4057-8c33-9479a275b130,network=Network(f961ab13-f798-4dec-a64f-b7eed3145036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ecf857-d6') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG os_vif [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:62:da,bridge_name='br-int',has_traffic_filtering=True,id=13ecf857-d666-4057-8c33-9479a275b130,network=Network(f961ab13-f798-4dec-a64f-b7eed3145036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ecf857-d6') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13ecf857-d6, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13ecf857-d6, col_values=(('external_ids', {'iface-id': '13ecf857-d666-4057-8c33-9479a275b130', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:62:da', 'vm-uuid': '9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:02 user nova-compute[73144]: INFO os_vif [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:62:da,bridge_name='br-int',has_traffic_filtering=True,id=13ecf857-d666-4057-8c33-9479a275b130,network=Network(f961ab13-f798-4dec-a64f-b7eed3145036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ecf857-d6')
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No VIF found with MAC fa:16:3e:96:62:da, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updated VIF entry in instance network info cache for port 13ecf857-d666-4057-8c33-9479a275b130. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG nova.network.neutron [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updating instance_info_cache with network_info: [{"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-50bf227f-b62f-4095-8b94-7dca66067c80 req-78e4e953-0df3-43b8-85dc-3468284275b7 service nova] Releasing lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:03 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-079ac47a-b015-4056-8508-1ec637dbbad9 req-86a8db92-ccc6-49ce-98b0-39677aefc1c8 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-079ac47a-b015-4056-8508-1ec637dbbad9 req-86a8db92-ccc6-49ce-98b0-39677aefc1c8 service nova] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-079ac47a-b015-4056-8508-1ec637dbbad9 req-86a8db92-ccc6-49ce-98b0-39677aefc1c8 service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-079ac47a-b015-4056-8508-1ec637dbbad9 req-86a8db92-ccc6-49ce-98b0-39677aefc1c8 service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG nova.compute.manager [req-079ac47a-b015-4056-8508-1ec637dbbad9 req-86a8db92-ccc6-49ce-98b0-39677aefc1c8 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] No waiting events found dispatching network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:04 user nova-compute[73144]: WARNING nova.compute.manager [req-079ac47a-b015-4056-8508-1ec637dbbad9 req-86a8db92-ccc6-49ce-98b0-39677aefc1c8 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received unexpected event network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 for instance with vm_state building and task_state spawning.
Aug 14 22:17:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:04 user nova-compute[73144]: INFO nova.compute.manager [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Unshelving
Aug 14 22:17:04 user nova-compute[73144]: INFO nova.virt.block_device [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Booting with volume dd57b1db-9896-40c9-8cd1-d508c863db0a at /dev/vda
Aug 14 22:17:04 user nova-compute[73144]: DEBUG os_brick.utils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f027d3bb-71e2-4bd9-82cd-1de2e004d4d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd71b6-60e2-470b-9ee5-c1af6a1793bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5c3d12-1214-4593-a07c-5d72ef1313b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[91872b3f-51f9-4b9d-9c08-ae2e870a6afd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:17:04 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:17:04 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce526da-500a-4f8b-8304-c3705b09b938]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG os_brick.utils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:17:04 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating existing volume attachment record: 1b42acb8-e47c-4cf6-9034-7757d4dd2f4d {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051425.9438157, 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:17:05 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] VM Resumed (Lifecycle Event)
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:17:05 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Instance spawned successfully.
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:05 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:06 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051425.9486637, 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:17:06 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] VM Started (Lifecycle Event)
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:17:06 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:17:06 user nova-compute[73144]: INFO nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-ed3f747f-2f56-4abc-8a24-0821851bfbc7 req-5956630a-9d00-4f25-9b95-0ad8fd17696d service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ed3f747f-2f56-4abc-8a24-0821851bfbc7 req-5956630a-9d00-4f25-9b95-0ad8fd17696d service nova] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ed3f747f-2f56-4abc-8a24-0821851bfbc7 req-5956630a-9d00-4f25-9b95-0ad8fd17696d service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ed3f747f-2f56-4abc-8a24-0821851bfbc7 req-5956630a-9d00-4f25-9b95-0ad8fd17696d service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:06 user nova-compute[73144]: DEBUG nova.compute.manager [req-ed3f747f-2f56-4abc-8a24-0821851bfbc7 req-5956630a-9d00-4f25-9b95-0ad8fd17696d service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] No waiting events found dispatching network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:06 user nova-compute[73144]: WARNING nova.compute.manager [req-ed3f747f-2f56-4abc-8a24-0821851bfbc7 req-5956630a-9d00-4f25-9b95-0ad8fd17696d service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received unexpected event network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 for instance with vm_state building and task_state spawning.
Aug 14 22:17:06 user nova-compute[73144]: INFO nova.compute.manager [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Took 6.49 seconds to build instance.
Aug 14 22:17:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e54dd989-1ec5-4c01-aad1-609440fb58e6 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.604s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:10 user nova-compute[73144]: INFO nova.compute.manager [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Detaching volume fca07579-9b87-4681-9432-c22590a9df0a
Aug 14 22:17:10 user nova-compute[73144]: INFO nova.virt.block_device [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Attempting to driver detach volume fca07579-9b87-4681-9432-c22590a9df0a from mountpoint /dev/vdb
Aug 14 22:17:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Attempting to detach device vdb from instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:17:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:17:10 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:17:10 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 22:17:10 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:17:10 user nova-compute[73144]:   <serial>fca07579-9b87-4681-9432-c22590a9df0a</serial>
Aug 14 22:17:10 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:17:10 user nova-compute[73144]: </disk>
Aug 14 22:17:10 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:17:10 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully detached device vdb from instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 from the persistent domain config.
Aug 14 22:17:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:17:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:17:10 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:17:10 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 22:17:10 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:17:10 user nova-compute[73144]:   <serial>fca07579-9b87-4681-9432-c22590a9df0a</serial>
Aug 14 22:17:10 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:17:10 user nova-compute[73144]: </disk>
Aug 14 22:17:10 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:17:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692051431.3884423, c0d17b12-3516-4e9d-9fe1-87cc7e99a249 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:17:11 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully detached device vdb from instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 from the live domain config.
Aug 14 22:17:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwqRhgnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:17:11 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad534be2-54f5-4813-a0f1-7cc4bd82e2f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[af029a26-343a-426f-8a6d-83f8cf14ef16]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:11 user nova-compute[73144]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a (non-flash)
Aug 14 22:17:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:11 user nova-compute[73144]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a (non-flash)
Aug 14 22:17:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa178366560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d557245d-3b84-4e76-83fb-a063a4fffdf6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[272d945c-6873-4437-88aa-5ec109bc1500]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0587c8-2fc9-4e16-bcea-4420c5900edc]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c8fcf-a1f0-46d2-bb5a-7bf7c0044749]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a892be85-0e37-4876-a0cb-fc0263befaf3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8b4e47-0756-4ce0-9b05-22948427e000]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260]
Aug 14 22:17:11 user nova-compute[73144]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a, portal: 172.16.0.220,3260] successful.
Aug 14 22:17:11 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af9abaf-c9b0-4e12-bd8a-0b6175f66387]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== disconnect_volume: return (294ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:17:11 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG nova.objects.instance [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'flavor' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-5bfa75ad-2b26-430a-84c0-7d49e2997f6a tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.609s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:12 user nova-compute[73144]: INFO nova.compute.manager [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Terminating instance
Aug 14 22:17:12 user nova-compute[73144]: DEBUG nova.compute.manager [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f8d2d05-dadf-43d7-a7b4-12650e01ff4b req-4873276a-4cf7-4050-9bf5-fc1ddd32b7e1 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-vif-unplugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3f8d2d05-dadf-43d7-a7b4-12650e01ff4b req-4873276a-4cf7-4050-9bf5-fc1ddd32b7e1 service nova] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3f8d2d05-dadf-43d7-a7b4-12650e01ff4b req-4873276a-4cf7-4050-9bf5-fc1ddd32b7e1 service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-3f8d2d05-dadf-43d7-a7b4-12650e01ff4b req-4873276a-4cf7-4050-9bf5-fc1ddd32b7e1 service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f8d2d05-dadf-43d7-a7b4-12650e01ff4b req-4873276a-4cf7-4050-9bf5-fc1ddd32b7e1 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] No waiting events found dispatching network-vif-unplugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:12 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f8d2d05-dadf-43d7-a7b4-12650e01ff4b req-4873276a-4cf7-4050-9bf5-fc1ddd32b7e1 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-vif-unplugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:17:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Instance destroyed successfully.
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.objects.instance [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lazy-loading 'resources' on Instance uuid c0d17b12-3516-4e9d-9fe1-87cc7e99a249 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1902301298',display_name='tempest-VolumesSnapshotTestJSON-instance-1902301298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1902301298',id=49,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwZUGxkBH3OB5HhSfBTkCf3XzsV+kyIQhsmIACOp5O9vEWBDKoiHr8BUxWMTPBO58ZPZ2IoQfvRmSz3b2Ru7LhgvfTrFBR20splBdMKEUcWu0Euqy5ctRwFKmyNrPiA6A==',key_name='tempest-keypair-1316694006',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:14:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33768265e13b425c9338be4ed4242a29',ramdisk_id='',reservation_id='r-1j31nm9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1006768833',owner_user_name='tempest-VolumesSnapshotTestJSON-1006768833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25e50ade908b447aaeb5dac6a9bb33af',uuid=c0d17b12-3516-4e9d-9fe1-87cc7e99a249,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converting VIF {"id": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "address": "fa:16:3e:e5:7b:e9", "network": {"id": "44322e78-2e6f-43e2-9ff0-ea98c8ea9722", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-798872366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33768265e13b425c9338be4ed4242a29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6fdc5cf-91", "ovs_interfaceid": "a6fdc5cf-91d6-466f-a2af-0f294d96da01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:7b:e9,bridge_name='br-int',has_traffic_filtering=True,id=a6fdc5cf-91d6-466f-a2af-0f294d96da01,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6fdc5cf-91') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_vif [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:7b:e9,bridge_name='br-int',has_traffic_filtering=True,id=a6fdc5cf-91d6-466f-a2af-0f294d96da01,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6fdc5cf-91') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6fdc5cf-91, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:17:13 user nova-compute[73144]: INFO os_vif [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:7b:e9,bridge_name='br-int',has_traffic_filtering=True,id=a6fdc5cf-91d6-466f-a2af-0f294d96da01,network=Network(44322e78-2e6f-43e2-9ff0-ea98c8ea9722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6fdc5cf-91')
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwqRhgnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:17:13 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca07579-9b87-4681-9432-c22590a9df0a', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55891e5-2109-4b75-8b3e-109e9091271c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[469ecd9f-29e1-4608-8bd8-c29f940bdd4d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:13 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1584c6170>, {}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Disconnecting from: [] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] <== disconnect_volume: return (53ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:17:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Deleting instance files /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249_del
Aug 14 22:17:13 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Deletion of /opt/stack/data/nova/instances/c0d17b12-3516-4e9d-9fe1-87cc7e99a249_del complete
Aug 14 22:17:13 user nova-compute[73144]: INFO nova.compute.manager [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'pci_requests' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'numa_topology' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:13 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:17:13 user nova-compute[73144]: INFO nova.compute.claims [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Claim successful on node user
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:14 user nova-compute[73144]: INFO nova.network.neutron [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating port b792bbc1-9911-4ab8-8563-18c34dd9e644 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-5bba0ab5-83aa-44ce-873f-062ca9d35de4 req-2a4838f2-225c-4259-8a1b-1ca3c5c022fe service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-vif-deleted-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:14 user nova-compute[73144]: INFO nova.compute.manager [req-5bba0ab5-83aa-44ce-873f-062ca9d35de4 req-2a4838f2-225c-4259-8a1b-1ca3c5c022fe service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Neutron deleted interface a6fdc5cf-91d6-466f-a2af-0f294d96da01; detaching it from the instance and deleting it from the info cache
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.network.neutron [req-5bba0ab5-83aa-44ce-873f-062ca9d35de4 req-2a4838f2-225c-4259-8a1b-1ca3c5c022fe service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:14 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Took 1.33 seconds to deallocate network for instance.
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-5bba0ab5-83aa-44ce-873f-062ca9d35de4 req-2a4838f2-225c-4259-8a1b-1ca3c5c022fe service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Detach interface failed, port_id=a6fdc5cf-91d6-466f-a2af-0f294d96da01, reason: Instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249 could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:17:14 user nova-compute[73144]: WARNING nova.volume.cinder [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Attachment d86196d1-e27d-433f-a3e0-d4e628d6033c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d86196d1-e27d-433f-a3e0-d4e628d6033c. (HTTP 404) (Request-ID: req-f1e7656e-bccb-48e0-8802-ccb1a4d36553)
Aug 14 22:17:14 user nova-compute[73144]: INFO nova.compute.manager [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Took 0.02 seconds to detach 1 volumes for instance.
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-bcd249c1-dea5-4880-8e1b-59f82aa8724b req-5b133179-9280-461d-92f7-4db3041fe593 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received event network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bcd249c1-dea5-4880-8e1b-59f82aa8724b req-5b133179-9280-461d-92f7-4db3041fe593 service nova] Acquiring lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bcd249c1-dea5-4880-8e1b-59f82aa8724b req-5b133179-9280-461d-92f7-4db3041fe593 service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bcd249c1-dea5-4880-8e1b-59f82aa8724b req-5b133179-9280-461d-92f7-4db3041fe593 service nova] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG nova.compute.manager [req-bcd249c1-dea5-4880-8e1b-59f82aa8724b req-5b133179-9280-461d-92f7-4db3041fe593 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] No waiting events found dispatching network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:14 user nova-compute[73144]: WARNING nova.compute.manager [req-bcd249c1-dea5-4880-8e1b-59f82aa8724b req-5b133179-9280-461d-92f7-4db3041fe593 service nova] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Received unexpected event network-vif-plugged-a6fdc5cf-91d6-466f-a2af-0f294d96da01 for instance with vm_state active and task_state deleting.
Aug 14 22:17:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:14 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:17:15 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Deleted allocations for instance c0d17b12-3516-4e9d-9fe1-87cc7e99a249
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.compute.manager [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing instance network info cache due to event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-4dd32881-e3ee-446e-8b12-b2e99f592802 tempest-VolumesSnapshotTestJSON-1006768833 tempest-VolumesSnapshotTestJSON-1006768833-project-member] Lock "c0d17b12-3516-4e9d-9fe1-87cc7e99a249" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.653s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.network.neutron [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:17:15 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Creating image(s)
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Ensure instance console log exists: /opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Start _get_guest_xml network_info=[{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '1b42acb8-e47c-4cf6-9034-7757d4dd2f4d', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57f47674-a3c4-44d9-8b02-0b3bdeae5c62', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd57b1db-9896-40c9-8cd1-d508c863db0a', 'serial': 'dd57b1db-9896-40c9-8cd1-d508c863db0a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.network.neutron [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:17:15 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:15 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:17:15 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:17:15 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:17:15 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba2136-8efa-407a-b1f1-5f76669e94a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:17:15 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd38d58-53e9-4304-bfe4-f3d231ca347e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a] added
Aug 14 22:17:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d468e7e-ace3-4443-93ab-11879ca86d0d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8030d92-c010-451a-8508-9dfa59dfb5f1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJUdjgZq {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJUdjgZq" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cde7de4-5bac-4c33-bc6c-3e9fb1386da2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJUdjgZq'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2ee5b8-28a9-4e4f-b6a3-70a1e601720c]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4129da-b778-4116-a719-f89eb84c2450]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4e748-6fe4-4709-bbea-239bc4e2e616]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]
Aug 14 22:17:15 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.
Aug 14 22:17:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ddc17-a71a-4e39-9cf0-3ec14a66ad84]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6ddf13-b949-4a8e-972f-d44d33b2ec95]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:15 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:17:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:15 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:17:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f0e54-255b-4d21-b7a1-f36162380d30]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:17:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updated VIF entry in instance network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.network.neutron [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-1aaf35a5-cb48-40bb-83f5-49c41e8ebaf3 req-0ddf7929-bb1f-42c0-970f-339451c3474d service nova] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26264626131393966', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264626131393966', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1582032628',display_name='tempest-TestShelveInstance-server-1582032628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1582032628',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1810898075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6cd8e6173bf4dc38aa9f99c854f5df4',ramdisk_id='',reservation_id='r-yx9lj9r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754427089',owner_user_name='tempest-TestShelveInstance-1754427089-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:17:04Z,user_data=None,user_id='53ae193a68f448e18a778310ae8ecc04',uuid=57f47674-a3c4-44d9-8b02-0b3bdeae5c62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converting VIF {"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'pci_devices' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:17:16 user nova-compute[73144]:   <uuid>57f47674-a3c4-44d9-8b02-0b3bdeae5c62</uuid>
Aug 14 22:17:16 user nova-compute[73144]:   <name>instance-00000030</name>
Aug 14 22:17:16 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:17:16 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:17:16 user nova-compute[73144]:   <metadata>
Aug 14 22:17:16 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:17:16 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:17:16 user nova-compute[73144]:       <nova:name>tempest-TestShelveInstance-server-1582032628</nova:name>
Aug 14 22:17:16 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:17:15</nova:creationTime>
Aug 14 22:17:16 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:17:16 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:17:16 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:17:16 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:17:16 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:17:16 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:17:16 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:17:16 user nova-compute[73144]:       <nova:owner>
Aug 14 22:17:16 user nova-compute[73144]:         <nova:user uuid="53ae193a68f448e18a778310ae8ecc04">tempest-TestShelveInstance-1754427089-project-member</nova:user>
Aug 14 22:17:16 user nova-compute[73144]:         <nova:project uuid="c6cd8e6173bf4dc38aa9f99c854f5df4">tempest-TestShelveInstance-1754427089</nova:project>
Aug 14 22:17:16 user nova-compute[73144]:       </nova:owner>
Aug 14 22:17:16 user nova-compute[73144]:       <nova:ports>
Aug 14 22:17:16 user nova-compute[73144]:         <nova:port uuid="b792bbc1-9911-4ab8-8563-18c34dd9e644">
Aug 14 22:17:16 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 22:17:16 user nova-compute[73144]:         </nova:port>
Aug 14 22:17:16 user nova-compute[73144]:       </nova:ports>
Aug 14 22:17:16 user nova-compute[73144]:     </nova:instance>
Aug 14 22:17:16 user nova-compute[73144]:   </metadata>
Aug 14 22:17:16 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:17:16 user nova-compute[73144]:     <system>
Aug 14 22:17:16 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:17:16 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:17:16 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:17:16 user nova-compute[73144]:       <entry name="serial">57f47674-a3c4-44d9-8b02-0b3bdeae5c62</entry>
Aug 14 22:17:16 user nova-compute[73144]:       <entry name="uuid">57f47674-a3c4-44d9-8b02-0b3bdeae5c62</entry>
Aug 14 22:17:16 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:17:16 user nova-compute[73144]:     </system>
Aug 14 22:17:16 user nova-compute[73144]:   </sysinfo>
Aug 14 22:17:16 user nova-compute[73144]:   <os>
Aug 14 22:17:16 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:17:16 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:17:16 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:17:16 user nova-compute[73144]:   </os>
Aug 14 22:17:16 user nova-compute[73144]:   <features>
Aug 14 22:17:16 user nova-compute[73144]:     <acpi/>
Aug 14 22:17:16 user nova-compute[73144]:     <apic/>
Aug 14 22:17:16 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:17:16 user nova-compute[73144]:   </features>
Aug 14 22:17:16 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:17:16 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:17:16 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:17:16 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:17:16 user nova-compute[73144]:   </clock>
Aug 14 22:17:16 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:17:16 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:17:16 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:17:16 user nova-compute[73144]:   </cpu>
Aug 14 22:17:16 user nova-compute[73144]:   <devices>
Aug 14 22:17:16 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:17:16 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:17:16 user nova-compute[73144]:       <source dev="/dev/sdc"/>
Aug 14 22:17:16 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:17:16 user nova-compute[73144]:       <serial>dd57b1db-9896-40c9-8cd1-d508c863db0a</serial>
Aug 14 22:17:16 user nova-compute[73144]:     </disk>
Aug 14 22:17:16 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:17:16 user nova-compute[73144]:       <mac address="fa:16:3e:3f:26:ab"/>
Aug 14 22:17:16 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:17:16 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:17:16 user nova-compute[73144]:       <target dev="tapb792bbc1-99"/>
Aug 14 22:17:16 user nova-compute[73144]:     </interface>
Aug 14 22:17:16 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:17:16 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62/console.log" append="off"/>
Aug 14 22:17:16 user nova-compute[73144]:     </serial>
Aug 14 22:17:16 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:17:16 user nova-compute[73144]:     <video>
Aug 14 22:17:16 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:17:16 user nova-compute[73144]:     </video>
Aug 14 22:17:16 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:17:16 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:17:16 user nova-compute[73144]:     </rng>
Aug 14 22:17:16 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:17:16 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:17:16 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:17:16 user nova-compute[73144]:     </memballoon>
Aug 14 22:17:16 user nova-compute[73144]:   </devices>
Aug 14 22:17:16 user nova-compute[73144]: </domain>
Aug 14 22:17:16 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1582032628',display_name='tempest-TestShelveInstance-server-1582032628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1582032628',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1810898075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c6cd8e6173bf4dc38aa9f99c854f5df4',ramdisk_id='',reservation_id='r-yx9lj9r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754427089',owner_user_name='tempest-TestShelveInstance-1754427089-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:17:04Z,user_data=None,user_id='53ae193a68f448e18a778310ae8ecc04',uuid=57f47674-a3c4-44d9-8b02-0b3bdeae5c62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converting VIF {"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG os_vif [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb792bbc1-99, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb792bbc1-99, col_values=(('external_ids', {'iface-id': 'b792bbc1-9911-4ab8-8563-18c34dd9e644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:26:ab', 'vm-uuid': '57f47674-a3c4-44d9-8b02-0b3bdeae5c62'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:17:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:16 user nova-compute[73144]: INFO os_vif [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99')
Aug 14 22:17:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:17:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] No VIF found with MAC fa:16:3e:3f:26:ab, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-f5d60141-908b-42df-8c57-e821e37eb5b5 req-f54c4171-a318-4421-8548-0f0b2bedb1b1 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f5d60141-908b-42df-8c57-e821e37eb5b5 req-f54c4171-a318-4421-8548-0f0b2bedb1b1 service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f5d60141-908b-42df-8c57-e821e37eb5b5 req-f54c4171-a318-4421-8548-0f0b2bedb1b1 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f5d60141-908b-42df-8c57-e821e37eb5b5 req-f54c4171-a318-4421-8548-0f0b2bedb1b1 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG nova.compute.manager [req-f5d60141-908b-42df-8c57-e821e37eb5b5 req-f54c4171-a318-4421-8548-0f0b2bedb1b1 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:18 user nova-compute[73144]: WARNING nova.compute.manager [req-f5d60141-908b-42df-8c57-e821e37eb5b5 req-f54c4171-a318-4421-8548-0f0b2bedb1b1 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received unexpected event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:18 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:19 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:19 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051440.4476457, 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:17:20 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] VM Resumed (Lifecycle Event)
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:17:20 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance spawned successfully.
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:17:20 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051440.4479423, 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:17:20 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] VM Started (Lifecycle Event)
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a626ea9-3dbb-416e-af02-2918bd27c27c req-48a7aa4b-9472-4742-8af6-bb393d2cb461 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a626ea9-3dbb-416e-af02-2918bd27c27c req-48a7aa4b-9472-4742-8af6-bb393d2cb461 service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a626ea9-3dbb-416e-af02-2918bd27c27c req-48a7aa4b-9472-4742-8af6-bb393d2cb461 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-2a626ea9-3dbb-416e-af02-2918bd27c27c req-48a7aa4b-9472-4742-8af6-bb393d2cb461 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a626ea9-3dbb-416e-af02-2918bd27c27c req-48a7aa4b-9472-4742-8af6-bb393d2cb461 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:20 user nova-compute[73144]: WARNING nova.compute.manager [req-2a626ea9-3dbb-416e-af02-2918bd27c27c req-48a7aa4b-9472-4742-8af6-bb393d2cb461 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received unexpected event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 22:17:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-2148d1a0-0dc5-436a-8c27-1f474c3d49de tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.176s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:20 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:17:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:22 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:17:23 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:23 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=25.111080169677734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-changed-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.manager [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Refreshing instance network info cache due to event network-changed-e8affea4-0e1c-461e-a393-79501753bd30. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] Acquiring lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] Acquired lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.network.neutron [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Refreshing network info cache for port e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cc85ca71-e7ac-4790-83b2-0887c3cab074 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:17:23 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updated VIF entry in instance network info cache for port e8affea4-0e1c-461e-a393-79501753bd30. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:17:24 user nova-compute[73144]: DEBUG nova.network.neutron [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating instance_info_cache with network_info: [{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-23b7a2aa-da3b-4acd-a47e-b42b50610037 req-78692fed-fc8a-43be-b326-6100a89a0385 service nova] Releasing lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:25 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:28 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051433.30167, c0d17b12-3516-4e9d-9fe1-87cc7e99a249 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:17:28 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] VM Stopped (Lifecycle Event)
Aug 14 22:17:28 user nova-compute[73144]: DEBUG nova.compute.manager [None req-84f3b4df-dc75-4110-a96c-2bcaa2d6fec6 None None] [instance: c0d17b12-3516-4e9d-9fe1-87cc7e99a249] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:17:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:17:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating instance_info_cache with network_info: [{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:17:30 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "7e4c3bea-d31a-42d6-b499-60194be3b01d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Starting instance... {{(pid=73144) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73144) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:17:36 user nova-compute[73144]: INFO nova.compute.claims [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Claim successful on node user
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Start building networks asynchronously for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Allocating IP information in the background. {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] allocate_for_instance() {{(pid=73144) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:17:36 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Start building block device mappings for instance. {{(pid=73144) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:17:36 user nova-compute[73144]: INFO nova.virt.block_device [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Booting with volume b495aafa-a74c-4775-b200-31ad74b11b58 at /dev/vda
Aug 14 22:17:36 user nova-compute[73144]: DEBUG nova.policy [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a3e93f724b43a08ee42b79c63ed4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f796a65843b467a9889f47789c87eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73144) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG os_brick.utils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1effcc-0324-4cc0-b71c-dbd557c88af1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e15b98-bfec-4cf4-a69d-6ac217bad116]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5fb5d2-094a-4815-8a0e-73dcd5c068ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54753dc-5cc4-48b6-a6fc-24010fd98fe3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:36 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:17:37 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:17:37 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7aeca4-96db-4469-bea9-11adbb8cd909]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG os_brick.utils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updating existing volume attachment record: 9eddf7c6-f951-4d20-9045-c473a2cdd261 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:37 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Successfully created port: 696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:17:38 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Successfully updated port: 696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquired lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Building network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-changed-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.compute.manager [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Refreshing instance network info cache due to event network-changed-696f6fc7-bb8a-473c-afba-3dec427b22b7. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] Acquiring lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Instance cache missing network info. {{(pid=73144) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.network.neutron [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updating instance_info_cache with network_info: [{"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Releasing lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Instance network_info: |[{"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73144) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] Acquired lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Refreshing network info cache for port 696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updated VIF entry in instance network info cache for port 696f6fc7-bb8a-473c-afba-3dec427b22b7. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG nova.network.neutron [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updating instance_info_cache with network_info: [{"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:17:39 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-16db348b-eee2-4072-a3e9-40444945eaa8 req-fd7609a6-6377-4355-9544-054b149def5c service nova] Releasing lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:17:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Start spawning the instance on the hypervisor. {{(pid=73144) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Creating instance directory {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:17:46 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Creating image(s)
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Did not create local disks {{(pid=73144) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Ensure instance console log exists: /opt/stack/data/nova/instances/7e4c3bea-d31a-42d6-b499-60194be3b01d/console.log {{(pid=73144) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Start _get_guest_xml network_info=[{"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '9eddf7c6-f951-4d20-9045-c473a2cdd261', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WpcGMzXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e4c3bea-d31a-42d6-b499-60194be3b01d', 'attached_at': '', 'detached_at': '', 'volume_id': 'b495aafa-a74c-4775-b200-31ad74b11b58', 'serial': 'b495aafa-a74c-4775-b200-31ad74b11b58'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:17:46 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:46 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller missing on host. {{(pid=73144) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.host [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU controller found on host. {{(pid=73144) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73144) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T21:41:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image limits 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flavor pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Image pref 0:0:0 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73144) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Got 1 possible topologies {{(pid=73144) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.hardware [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73144) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WpcGMzXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:17:46 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:17:46 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:17:46 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e56452b-ceb3-46a0-aeac-1d0f4db34acd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:17:46 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9743367f-d180-4516-9656-876f4dad57bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58] added
Aug 14 22:17:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a7fd9-5931-4030-bbcc-24c887dd93c3]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b50771-c72f-4fc7-a6ff-95317aba24d2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WpcGMzXD {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WpcGMzXD" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[032dcae7-2c76-4904-9f93-885efdb3d2e4]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WpcGMzXD'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[216163cd-dca7-4e0b-afc9-2eb0359cb815]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1cf75b-20f9-44c5-b2cd-e515aa5e5aa0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:46 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:17:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:46 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:17:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8bd1ac-7161-43fe-aca5-c18a89fa1ee5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260]
Aug 14 22:17:46 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260] successful.
Aug 14 22:17:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc30cc-9ef8-4327-9ae6-66df2bfe37b5]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f657b403-c1e1-428d-a699-3886d363d5bb]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:46 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:17:46 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:17:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:17:46 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:17:46 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:17:46 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2703aa6-aa67-4f01-9344-8fa911cf1504]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:17:46 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: None {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WpcGMzXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26331333961663930', 'path': '/dev/sdd'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331333961663930', 'path': '/dev/sdd'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1718267005',display_name='tempest-TestVolumeBootPattern-server-1718267005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1718267005',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-8rhsyrxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:17:37Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=7e4c3bea-d31a-42d6-b499-60194be3b01d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73144) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:14,bridge_name='br-int',has_traffic_filtering=True,id=696f6fc7-bb8a-473c-afba-3dec427b22b7,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696f6fc7-bb') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e4c3bea-d31a-42d6-b499-60194be3b01d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:17:47 user nova-compute[73144]:   <uuid>7e4c3bea-d31a-42d6-b499-60194be3b01d</uuid>
Aug 14 22:17:47 user nova-compute[73144]:   <name>instance-00000034</name>
Aug 14 22:17:47 user nova-compute[73144]:   <memory>524288</memory>
Aug 14 22:17:47 user nova-compute[73144]:   <vcpu>1</vcpu>
Aug 14 22:17:47 user nova-compute[73144]:   <metadata>
Aug 14 22:17:47 user nova-compute[73144]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:17:47 user nova-compute[73144]:       <nova:package version="0.0.0"/>
Aug 14 22:17:47 user nova-compute[73144]:       <nova:name>tempest-TestVolumeBootPattern-server-1718267005</nova:name>
Aug 14 22:17:47 user nova-compute[73144]:       <nova:creationTime>2023-08-14 22:17:46</nova:creationTime>
Aug 14 22:17:47 user nova-compute[73144]:       <nova:flavor name="m1.tiny">
Aug 14 22:17:47 user nova-compute[73144]:         <nova:memory>512</nova:memory>
Aug 14 22:17:47 user nova-compute[73144]:         <nova:disk>1</nova:disk>
Aug 14 22:17:47 user nova-compute[73144]:         <nova:swap>0</nova:swap>
Aug 14 22:17:47 user nova-compute[73144]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:17:47 user nova-compute[73144]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:17:47 user nova-compute[73144]:       </nova:flavor>
Aug 14 22:17:47 user nova-compute[73144]:       <nova:owner>
Aug 14 22:17:47 user nova-compute[73144]:         <nova:user uuid="52a3e93f724b43a08ee42b79c63ed4d0">tempest-TestVolumeBootPattern-790116957-project-member</nova:user>
Aug 14 22:17:47 user nova-compute[73144]:         <nova:project uuid="0f796a65843b467a9889f47789c87eed">tempest-TestVolumeBootPattern-790116957</nova:project>
Aug 14 22:17:47 user nova-compute[73144]:       </nova:owner>
Aug 14 22:17:47 user nova-compute[73144]:       <nova:ports>
Aug 14 22:17:47 user nova-compute[73144]:         <nova:port uuid="696f6fc7-bb8a-473c-afba-3dec427b22b7">
Aug 14 22:17:47 user nova-compute[73144]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 22:17:47 user nova-compute[73144]:         </nova:port>
Aug 14 22:17:47 user nova-compute[73144]:       </nova:ports>
Aug 14 22:17:47 user nova-compute[73144]:     </nova:instance>
Aug 14 22:17:47 user nova-compute[73144]:   </metadata>
Aug 14 22:17:47 user nova-compute[73144]:   <sysinfo type="smbios">
Aug 14 22:17:47 user nova-compute[73144]:     <system>
Aug 14 22:17:47 user nova-compute[73144]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:17:47 user nova-compute[73144]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:17:47 user nova-compute[73144]:       <entry name="version">0.0.0</entry>
Aug 14 22:17:47 user nova-compute[73144]:       <entry name="serial">7e4c3bea-d31a-42d6-b499-60194be3b01d</entry>
Aug 14 22:17:47 user nova-compute[73144]:       <entry name="uuid">7e4c3bea-d31a-42d6-b499-60194be3b01d</entry>
Aug 14 22:17:47 user nova-compute[73144]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:17:47 user nova-compute[73144]:     </system>
Aug 14 22:17:47 user nova-compute[73144]:   </sysinfo>
Aug 14 22:17:47 user nova-compute[73144]:   <os>
Aug 14 22:17:47 user nova-compute[73144]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:17:47 user nova-compute[73144]:     <boot dev="hd"/>
Aug 14 22:17:47 user nova-compute[73144]:     <smbios mode="sysinfo"/>
Aug 14 22:17:47 user nova-compute[73144]:   </os>
Aug 14 22:17:47 user nova-compute[73144]:   <features>
Aug 14 22:17:47 user nova-compute[73144]:     <acpi/>
Aug 14 22:17:47 user nova-compute[73144]:     <apic/>
Aug 14 22:17:47 user nova-compute[73144]:     <vmcoreinfo/>
Aug 14 22:17:47 user nova-compute[73144]:   </features>
Aug 14 22:17:47 user nova-compute[73144]:   <clock offset="utc">
Aug 14 22:17:47 user nova-compute[73144]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:17:47 user nova-compute[73144]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:17:47 user nova-compute[73144]:     <timer name="hpet" present="no"/>
Aug 14 22:17:47 user nova-compute[73144]:   </clock>
Aug 14 22:17:47 user nova-compute[73144]:   <cpu mode="custom" match="exact">
Aug 14 22:17:47 user nova-compute[73144]:     <model>Nehalem</model>
Aug 14 22:17:47 user nova-compute[73144]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:17:47 user nova-compute[73144]:   </cpu>
Aug 14 22:17:47 user nova-compute[73144]:   <devices>
Aug 14 22:17:47 user nova-compute[73144]:     <disk type="block" device="disk">
Aug 14 22:17:47 user nova-compute[73144]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:17:47 user nova-compute[73144]:       <source dev="/dev/sdd"/>
Aug 14 22:17:47 user nova-compute[73144]:       <target dev="vda" bus="virtio"/>
Aug 14 22:17:47 user nova-compute[73144]:       <serial>b495aafa-a74c-4775-b200-31ad74b11b58</serial>
Aug 14 22:17:47 user nova-compute[73144]:     </disk>
Aug 14 22:17:47 user nova-compute[73144]:     <interface type="ethernet">
Aug 14 22:17:47 user nova-compute[73144]:       <mac address="fa:16:3e:f8:75:14"/>
Aug 14 22:17:47 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:17:47 user nova-compute[73144]:       <mtu size="1442"/>
Aug 14 22:17:47 user nova-compute[73144]:       <target dev="tap696f6fc7-bb"/>
Aug 14 22:17:47 user nova-compute[73144]:     </interface>
Aug 14 22:17:47 user nova-compute[73144]:     <serial type="pty">
Aug 14 22:17:47 user nova-compute[73144]:       <log file="/opt/stack/data/nova/instances/7e4c3bea-d31a-42d6-b499-60194be3b01d/console.log" append="off"/>
Aug 14 22:17:47 user nova-compute[73144]:     </serial>
Aug 14 22:17:47 user nova-compute[73144]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:17:47 user nova-compute[73144]:     <video>
Aug 14 22:17:47 user nova-compute[73144]:       <model type="virtio"/>
Aug 14 22:17:47 user nova-compute[73144]:     </video>
Aug 14 22:17:47 user nova-compute[73144]:     <rng model="virtio">
Aug 14 22:17:47 user nova-compute[73144]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:17:47 user nova-compute[73144]:     </rng>
Aug 14 22:17:47 user nova-compute[73144]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:17:47 user nova-compute[73144]:     <memballoon model="virtio">
Aug 14 22:17:47 user nova-compute[73144]:       <stats period="10"/>
Aug 14 22:17:47 user nova-compute[73144]:     </memballoon>
Aug 14 22:17:47 user nova-compute[73144]:   </devices>
Aug 14 22:17:47 user nova-compute[73144]: </domain>
Aug 14 22:17:47 user nova-compute[73144]:  {{(pid=73144) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1718267005',display_name='tempest-TestVolumeBootPattern-server-1718267005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1718267005',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-8rhsyrxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:17:37Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=7e4c3bea-d31a-42d6-b499-60194be3b01d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:14,bridge_name='br-int',has_traffic_filtering=True,id=696f6fc7-bb8a-473c-afba-3dec427b22b7,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696f6fc7-bb') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG os_vif [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:14,bridge_name='br-int',has_traffic_filtering=True,id=696f6fc7-bb8a-473c-afba-3dec427b22b7,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696f6fc7-bb') {{(pid=73144) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap696f6fc7-bb, may_exist=True, interface_attrs={}) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap696f6fc7-bb, col_values=(('external_ids', {'iface-id': '696f6fc7-bb8a-473c-afba-3dec427b22b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:75:14', 'vm-uuid': '7e4c3bea-d31a-42d6-b499-60194be3b01d'}),), if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:47 user nova-compute[73144]: INFO os_vif [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:14,bridge_name='br-int',has_traffic_filtering=True,id=696f6fc7-bb8a-473c-afba-3dec427b22b7,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696f6fc7-bb')
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:17:47 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] No VIF found with MAC fa:16:3e:f8:75:14, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:17:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf9864e9-8205-4bb0-8ccb-7c0bb58d1ba5 req-bee846cb-cd6e-4674-bebc-ce260b134565 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf9864e9-8205-4bb0-8ccb-7c0bb58d1ba5 req-bee846cb-cd6e-4674-bebc-ce260b134565 service nova] Acquiring lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf9864e9-8205-4bb0-8ccb-7c0bb58d1ba5 req-bee846cb-cd6e-4674-bebc-ce260b134565 service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:49 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-cf9864e9-8205-4bb0-8ccb-7c0bb58d1ba5 req-bee846cb-cd6e-4674-bebc-ce260b134565 service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:49 user nova-compute[73144]: DEBUG nova.compute.manager [req-cf9864e9-8205-4bb0-8ccb-7c0bb58d1ba5 req-bee846cb-cd6e-4674-bebc-ce260b134565 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] No waiting events found dispatching network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:49 user nova-compute[73144]: WARNING nova.compute.manager [req-cf9864e9-8205-4bb0-8ccb-7c0bb58d1ba5 req-bee846cb-cd6e-4674-bebc-ce260b134565 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received unexpected event network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 for instance with vm_state building and task_state spawning.
Aug 14 22:17:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:49 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051471.0663342, 7e4c3bea-d31a-42d6-b499-60194be3b01d => Resumed> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:17:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] VM Resumed (Lifecycle Event)
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Instance event wait completed in 0 seconds for  {{(pid=73144) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Guest created on hypervisor {{(pid=73144) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:17:51 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Instance spawned successfully.
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Found default for hw_cdrom_bus of ide {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Found default for hw_disk_bus of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Found default for hw_input_bus of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Found default for hw_pointer_model of None {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Found default for hw_video_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Found default for hw_vif_model of virtio {{(pid=73144) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:17:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.virt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Emitting event <LifecycleEvent: 1692051471.0680087, 7e4c3bea-d31a-42d6-b499-60194be3b01d => Started> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:17:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] VM Started (Lifecycle Event)
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73144) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:17:51 user nova-compute[73144]: INFO nova.compute.manager [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7b83866-8926-4a12-ad15-1c222a90c171 req-89368699-444c-48a1-8560-fac2903a1e93 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7b83866-8926-4a12-ad15-1c222a90c171 req-89368699-444c-48a1-8560-fac2903a1e93 service nova] Acquiring lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7b83866-8926-4a12-ad15-1c222a90c171 req-89368699-444c-48a1-8560-fac2903a1e93 service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d7b83866-8926-4a12-ad15-1c222a90c171 req-89368699-444c-48a1-8560-fac2903a1e93 service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [req-d7b83866-8926-4a12-ad15-1c222a90c171 req-89368699-444c-48a1-8560-fac2903a1e93 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] No waiting events found dispatching network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:17:51 user nova-compute[73144]: WARNING nova.compute.manager [req-d7b83866-8926-4a12-ad15-1c222a90c171 req-89368699-444c-48a1-8560-fac2903a1e93 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received unexpected event network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 for instance with vm_state building and task_state spawning.
Aug 14 22:17:51 user nova-compute[73144]: INFO nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 14 22:17:51 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:17:51 user nova-compute[73144]: INFO nova.compute.manager [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Took 14.87 seconds to build instance.
Aug 14 22:17:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ad4752e8-669d-46c9-8200-f2da80ac9a6b tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.967s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:17:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:17:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:02 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:12 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:17 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:21 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:21 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:18:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:18:25 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:18:25 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8310MB free_disk=25.106807708740234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cc85ca71-e7ac-4790-83b2-0887c3cab074 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 7e4c3bea-d31a-42d6-b499-60194be3b01d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:18:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:18:27 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:18:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:18:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Rebuilding the list of instances to heal {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:18:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:18:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:18:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:18:29 user nova-compute[73144]: DEBUG nova.objects.instance [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lazy-loading 'info_cache' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:18:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:18:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:18:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:18:31 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:18:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:18:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-changed-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:18:50 user nova-compute[73144]: DEBUG nova.compute.manager [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Refreshing instance network info cache due to event network-changed-13ecf857-d666-4057-8c33-9479a275b130. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:18:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] Acquiring lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:18:50 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] Acquired lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:18:50 user nova-compute[73144]: DEBUG nova.network.neutron [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Refreshing network info cache for port 13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG nova.network.neutron [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updated VIF entry in instance network info cache for port 13ecf857-d666-4057-8c33-9479a275b130. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG nova.network.neutron [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updating instance_info_cache with network_info: [{"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-e3be452e-f846-4be8-bb81-ef2b9c99e778 req-872897db-8403-4136-a036-52d365caead1 service nova] Releasing lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'flavor' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:51 user nova-compute[73144]: INFO nova.compute.manager [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Attaching volume 5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba to /dev/vdb
Aug 14 22:18:51 user nova-compute[73144]: DEBUG os_brick.utils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a1551-5b7f-490e-850b-2c4a342efeb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[338592e1-98cc-41f6-a932-d6cbc55ef0ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6df6115-e585-4dd5-9f82-248a62921ba1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a830edc-f5c1-489a-bf6b-5d381d1417bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:18:51 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:18:51 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[583de8ba-256d-4040-a623-97b9fec6653f]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:18:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:18:52 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:18:52 user nova-compute[73144]: DEBUG os_brick.utils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:18:52 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updating existing volume attachment record: 71a0d41c-4bc2-46c1-b1f7-95153efe3c32 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:18:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing instance network info cache due to event network-changed-b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] Acquiring lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] Acquired lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG nova.network.neutron [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Refreshing network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:18:55 user nova-compute[73144]: INFO nova.compute.manager [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Terminating instance
Aug 14 22:18:55 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc20d5a2-3b74-44a7-a2ac-69d6e538dd39 req-46f10db3-49b4-4155-8b57-4b1d596f8cbe service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-unplugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc20d5a2-3b74-44a7-a2ac-69d6e538dd39 req-46f10db3-49b4-4155-8b57-4b1d596f8cbe service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc20d5a2-3b74-44a7-a2ac-69d6e538dd39 req-46f10db3-49b4-4155-8b57-4b1d596f8cbe service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-bc20d5a2-3b74-44a7-a2ac-69d6e538dd39 req-46f10db3-49b4-4155-8b57-4b1d596f8cbe service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc20d5a2-3b74-44a7-a2ac-69d6e538dd39 req-46f10db3-49b4-4155-8b57-4b1d596f8cbe service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-unplugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:18:55 user nova-compute[73144]: DEBUG nova.compute.manager [req-bc20d5a2-3b74-44a7-a2ac-69d6e538dd39 req-46f10db3-49b4-4155-8b57-4b1d596f8cbe service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-unplugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.network.neutron [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updated VIF entry in instance network info cache for port b792bbc1-9911-4ab8-8563-18c34dd9e644. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.network.neutron [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [{"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-37382634-d148-4286-983c-a2fcd13bec00 req-2d666001-aa6e-4dee-a89a-517322ddeb18 service nova] Releasing lock "refresh_cache-57f47674-a3c4-44d9-8b02-0b3bdeae5c62" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:18:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Instance destroyed successfully.
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.objects.instance [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lazy-loading 'resources' on Instance uuid 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1582032628',display_name='tempest-TestShelveInstance-server-1582032628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1582032628',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyjogbPWdMjyrXe3p70Vul0z43jN2t4FRLtvhfLhpoiAv+aTDsfm7ezczVgMwRuRjvbdVAI9pYKMA6a2GIU3QB/32e1FH53z+NlI1u6N3rDgRaRP7/tSZGvHrQtzg81kw==',key_name='tempest-TestShelveInstance-1810898075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6cd8e6173bf4dc38aa9f99c854f5df4',ramdisk_id='',reservation_id='r-yx9lj9r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754427089',owner_user_name='tempest-TestShelveInstance-1754427089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:17:21Z,user_data=None,user_id='53ae193a68f448e18a778310ae8ecc04',uuid=57f47674-a3c4-44d9-8b02-0b3bdeae5c62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converting VIF {"id": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "address": "fa:16:3e:3f:26:ab", "network": {"id": "cd0b2087-f421-46f0-aaf7-a8e9167e3430", "bridge": "br-int", "label": "tempest-TestShelveInstance-1681417267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6cd8e6173bf4dc38aa9f99c854f5df4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb792bbc1-99", "ovs_interfaceid": "b792bbc1-9911-4ab8-8563-18c34dd9e644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_vif [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb792bbc1-99, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:18:56 user nova-compute[73144]: INFO os_vif [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:26:ab,bridge_name='br-int',has_traffic_filtering=True,id=b792bbc1-9911-4ab8-8563-18c34dd9e644,network=Network(cd0b2087-f421-46f0-aaf7-a8e9167e3430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb792bbc1-99')
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJUdjgZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:18:56 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5648257-2e00-49b5-a8df-ca17167181e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb259df9-8cad-4434-b320-f35b7f00c948]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:18:56 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:18:56 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:18:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:18:56 user nova-compute[73144]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a (non-flash)
Aug 14 22:18:56 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:18:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1583d9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8d2070-0b97-4fc5-a7b0-5af43bc06aff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620d5ed-d5a9-4742-ac13-bc9b1420654d]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[065e5399-929f-48f6-974b-d01506c895ce]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e9480c-c1eb-4955-a52a-867ccf31b6e8]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26264626131393966', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e7bab83c', '/dev/disk/by-id/scsi-1SCST_BIOe7bab83c-bdba199f3712ef54') {{(pid=84572) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e0d649-11ed-4bcc-b2ef-3867455579e6]: (4, None) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f4c7fa-906b-4ca0-a5a4-47182811d8a2]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[010776db-f1b4-4527-8258-d03407ef62b1]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260]
Aug 14 22:18:56 user nova-compute[73144]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a, portal: 172.16.0.220,3260] successful.
Aug 14 22:18:56 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd57b1db-9896-40c9-8cd1-d508c863db0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc2a19-b471-4e84-9c4a-240f94baca6b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] <== disconnect_volume: return (320ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:18:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Deleting instance files /opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62_del
Aug 14 22:18:56 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Deletion of /opt/stack/data/nova/instances/57f47674-a3c4-44d9-8b02-0b3bdeae5c62_del complete
Aug 14 22:18:56 user nova-compute[73144]: INFO nova.compute.manager [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 14 22:18:56 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:18:56 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:18:57 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:18:57 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Took 0.66 seconds to deallocate network for instance.
Aug 14 22:18:57 user nova-compute[73144]: DEBUG nova.compute.manager [req-10b7bfc9-44d6-49ca-befb-c36723b65fb0 req-3b66eaba-abf8-4441-84f3-a102f1b12281 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-deleted-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:18:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-ad854e94-4e06-40ff-832b-498ee578d242 req-61fa65bb-1d63-4ad4-a60b-01665a54e644 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ad854e94-4e06-40ff-832b-498ee578d242 req-61fa65bb-1d63-4ad4-a60b-01665a54e644 service nova] Acquiring lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ad854e94-4e06-40ff-832b-498ee578d242 req-61fa65bb-1d63-4ad4-a60b-01665a54e644 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-ad854e94-4e06-40ff-832b-498ee578d242 req-61fa65bb-1d63-4ad4-a60b-01665a54e644 service nova] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG nova.compute.manager [req-ad854e94-4e06-40ff-832b-498ee578d242 req-61fa65bb-1d63-4ad4-a60b-01665a54e644 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] No waiting events found dispatching network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:18:58 user nova-compute[73144]: WARNING nova.compute.manager [req-ad854e94-4e06-40ff-832b-498ee578d242 req-61fa65bb-1d63-4ad4-a60b-01665a54e644 service nova] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Received unexpected event network-vif-plugged-b792bbc1-9911-4ab8-8563-18c34dd9e644 for instance with vm_state active and task_state deleting.
Aug 14 22:18:58 user nova-compute[73144]: INFO nova.compute.manager [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Took 0.77 seconds to detach 1 volumes for instance.
Aug 14 22:18:58 user nova-compute[73144]: DEBUG nova.compute.manager [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Deleting volume: dd57b1db-9896-40c9-8cd1-d508c863db0a {{(pid=73144) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:18:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:18:58 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Deleted allocations for instance 57f47674-a3c4-44d9-8b02-0b3bdeae5c62
Aug 14 22:18:58 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-8e908c13-bdfe-40ac-b059-ec0a39923d3b tempest-TestShelveInstance-1754427089 tempest-TestShelveInstance-1754427089-project-member] Lock "57f47674-a3c4-44d9-8b02-0b3bdeae5c62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.088s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PELnlIUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:19:01 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:19:01 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:19:01 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8772b94-08e8-46af-8278-b4802b76490a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:19:01 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[27efaf6c-ea0c-457d-b3e5-fa78cc62acce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba] added
Aug 14 22:19:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc72148-799c-4286-8c9d-b291f02ce12f]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a5089-a849-427c-b931-c1f83d454e93]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PELnlIUD {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PELnlIUD" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fa1c20-164d-4b13-9603-0fc7b30ae3db]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PELnlIUD'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313a9bf-4320-46be-9aae-6021dc5edba1]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f0d68b-a4f3-4cba-87d3-21f199e7a6a0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:01 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:01 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e85a3b-ae5e-46f7-b240-10054c6f1551]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260]
Aug 14 22:19:01 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260] successful.
Aug 14 22:19:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a219b7-470c-4313-b53e-89698c812eee]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778977e-b81f-4490-a0f6-0f0c22c1217b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:01 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:01 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:01 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:01 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:01 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb66b1-dd4e-4ea3-975b-87a3acdf5017]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PELnlIUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:19:01 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23963396430333230', 'path': '/dev/sdc'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963396430333230', 'path': '/dev/sdc'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG nova.objects.instance [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'flavor' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:19:02 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:19:02 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 22:19:02 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:19:02 user nova-compute[73144]:   <serial>5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba</serial>
Aug 14 22:19:02 user nova-compute[73144]: </disk>
Aug 14 22:19:02 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No VIF found with MAC fa:16:3e:96:62:da, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:19:02 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-d0227b28-e74f-4ef4-b5b9-47182ee71365 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.172s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG nova.objects.instance [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'flavor' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:06 user nova-compute[73144]: INFO nova.compute.manager [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Attaching volume 7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 to /dev/vdc
Aug 14 22:19:06 user nova-compute[73144]: DEBUG os_brick.utils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[62890916-2c25-42b2-854e-94873fac4921]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f5dfac19a4dc\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3003d7c-41dc-4e8d-a24b-90b8fa5aa98d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07d7aab-6d37-4ceb-b108-d02a6be467c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9a6d9b-a99f-4c00-b140-14a8f014232f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Running cmd (subprocess): nvme version {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] nvme not present on system {{(pid=73144) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:19:06 user nova-compute[73144]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:19:06 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdf0579-4aed-4bb3-be12-47dc14f5b04e]: (4, '') {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73144) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.lightos [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] LIGHTOS: no hostnqn found. {{(pid=73144) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG os_brick.utils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f5dfac19a4dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:19:06 user nova-compute[73144]: DEBUG nova.virt.block_device [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updating existing volume attachment record: 3ef662e0-2bcb-48ef-8d94-9ac7eea48137 {{(pid=73144) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:19:07 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:11 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051536.3579051, 57f47674-a3c4-44d9-8b02-0b3bdeae5c62 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:19:11 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] VM Stopped (Lifecycle Event)
Aug 14 22:19:11 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e9affc0b-d821-42c9-bc4a-721824211c9a None None] [instance: 57f47674-a3c4-44d9-8b02-0b3bdeae5c62] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:19:11 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Calling os-brick to attach iSCSI Volume {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCOZmNHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:19:15 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:19:15 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:19:15 user nova-compute[73144]: INFO os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e36c5a-5a70-47b0-8109-c79216dae497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:19:15 user nova-compute[73144]:  {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[13408a8a-2b7d-4e24-9afd-242c0bcb1e7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7] added\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7] added
Aug 14 22:19:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118d106-22ec-4e2d-ab7d-e3f1941a14a6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0442001a-0482-47e3-abad-d0dd22f00098]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCOZmNHd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCOZmNHd" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a2730-f2fe-45bb-93da-d424fa87b7f0]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eCOZmNHd'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac605fd-4f1c-40cf-ae50-073f96983c5d]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[109fdb6b-c95d-4d4e-9d16-5b181b8187a8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --login {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b08d77e-f121-4206-a871-8fdbe047b230]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260]
Aug 14 22:19:15 user nova-compute[73144]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260] successful.
Aug 14 22:19:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a54f33-4d59-4840-a22f-d02bc40eaff6]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b3482-a347-43a7-ac20-027fec76bb4c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 (non-flash)
Aug 14 22:19:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:15 user nova-compute[73144]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 (non-flash)
Aug 14 22:19:15 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Connected to 172.16.0.220:3260 {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] HCTL ('36', '-', '-', 0) found on session 62 with lun 0 {{(pid=73144) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73144) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d0396-fd89-4796-bebb-188ca376d4f3]: (4, ('- - 0', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Searching for a device in session 62 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73144) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:19:15 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCOZmNHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73144) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:19:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:19:16 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23364326366336432', 'path': '/dev/sde'} {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:19:16 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364326366336432', 'path': '/dev/sde'} {{(pid=73144) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:19:16 user nova-compute[73144]: DEBUG nova.objects.instance [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'flavor' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:19:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:19:17 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:19:17 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 22:19:17 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 22:19:17 user nova-compute[73144]:   <serial>7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7</serial>
Aug 14 22:19:17 user nova-compute[73144]: </disk>
Aug 14 22:19:17 user nova-compute[73144]:  {{(pid=73144) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:19:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:19:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:19:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73144) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:19:17 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] No VIF found with MAC fa:16:3e:96:62:da, not building metadata {{(pid=73144) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:19:17 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-acabf827-f7a8-435b-b258-c75611a90972 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.066s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:18 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:18 user nova-compute[73144]: INFO nova.compute.manager [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Detaching volume 7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7
Aug 14 22:19:18 user nova-compute[73144]: INFO nova.virt.block_device [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Attempting to driver detach volume 7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 from mountpoint /dev/vdc
Aug 14 22:19:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Attempting to detach device vdc from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:19:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:19:18 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:19:18 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 22:19:18 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 22:19:18 user nova-compute[73144]:   <serial>7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7</serial>
Aug 14 22:19:18 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 22:19:18 user nova-compute[73144]: </disk>
Aug 14 22:19:18 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:19:18 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Successfully detached device vdc from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the persistent domain config.
Aug 14 22:19:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:19:18 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:19:18 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:19:18 user nova-compute[73144]:   <source dev="/dev/sde"/>
Aug 14 22:19:18 user nova-compute[73144]:   <target dev="vdc" bus="virtio"/>
Aug 14 22:19:18 user nova-compute[73144]:   <serial>7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7</serial>
Aug 14 22:19:18 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 22:19:18 user nova-compute[73144]: </disk>
Aug 14 22:19:18 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692051559.1527991, 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:19:19 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Successfully detached device vdc from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the live domain config.
Aug 14 22:19:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCOZmNHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:19:19 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e703e75-6e22-411b-b121-9221f5cb0dec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884ef34-db64-43d1-af6d-f67651c2147b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:19 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:19 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:19 user nova-compute[73144]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 (non-flash)
Aug 14 22:19:19 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:19 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:19 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:19 user nova-compute[73144]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 (non-flash)
Aug 14 22:19:19 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa15868a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7'): ({'sde'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Removing single pathed devices sde {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c016ba90-1c42-42a6-860e-e0ae0a02c65d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c826cdc3-a990-4025-8f83-1aa59a799b03]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Flushing IO for device /dev/sde {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02fe5fd-73df-4e02-a9f5-6b25ff02dbdc]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf0c021-3aa1-48bf-9dfe-d8425d282cfd]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] SCSI volumes sde have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544be76-ec95-4625-bae6-8e0cd2e88dab]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[953ae8e3-dc1d-4b6f-b8c2-b6887268a9f4]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260]
Aug 14 22:19:19 user nova-compute[73144]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7, portal: 172.16.0.220,3260] successful.
Aug 14 22:19:19 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff7a5a1-ce2c-4edd-9689-47766b1ae9e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[da382c90-560a-41ef-9dcf-0d76ab83e83b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] <== disconnect_volume: return (307ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:19:19 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:19:20 user nova-compute[73144]: DEBUG nova.objects.instance [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'flavor' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:19:20 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-12627a61-cd46-4b1e-a928-e3caa09a85c0 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.762s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:21 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:19:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:23 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:24 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:19:25 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:19:25 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8401MB free_disk=25.096080780029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cc85ca71-e7ac-4790-83b2-0887c3cab074 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 7e4c3bea-d31a-42d6-b499-60194be3b01d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:19:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:26 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-changed-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:19:28 user nova-compute[73144]: DEBUG nova.compute.manager [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Refreshing instance network info cache due to event network-changed-696f6fc7-bb8a-473c-afba-3dec427b22b7. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:19:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] Acquiring lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:19:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] Acquired lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:19:28 user nova-compute[73144]: DEBUG nova.network.neutron [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Refreshing network info cache for port 696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-changed-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.compute.manager [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Refreshing instance network info cache due to event network-changed-696f6fc7-bb8a-473c-afba-3dec427b22b7. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] Acquiring lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "7e4c3bea-d31a-42d6-b499-60194be3b01d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:29 user nova-compute[73144]: INFO nova.compute.manager [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Terminating instance
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updated VIF entry in instance network info cache for port 696f6fc7-bb8a-473c-afba-3dec427b22b7. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updating instance_info_cache with network_info: [{"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-66f2ca5a-22e5-49bd-872f-f4a56f5dd0e6 req-0b40a88e-0bd8-413a-a4e1-9638b4ad8b47 service nova] Releasing lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] Acquired lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Refreshing network info cache for port 696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updated VIF entry in instance network info cache for port 696f6fc7-bb8a-473c-afba-3dec427b22b7. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG nova.network.neutron [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updating instance_info_cache with network_info: [{"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:19:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-b77e2320-3ac1-4e3c-a55c-7ea405352172 req-eae9471d-23f0-48de-88b1-a9870b17bcf8 service nova] Releasing lock "refresh_cache-7e4c3bea-d31a-42d6-b499-60194be3b01d" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:19:30 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Instance destroyed successfully.
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.objects.instance [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'resources' on Instance uuid 7e4c3bea-d31a-42d6-b499-60194be3b01d {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1718267005',display_name='tempest-TestVolumeBootPattern-server-1718267005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1718267005',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-8rhsyrxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:17:51Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=7e4c3bea-d31a-42d6-b499-60194be3b01d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "address": "fa:16:3e:f8:75:14", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696f6fc7-bb", "ovs_interfaceid": "696f6fc7-bb8a-473c-afba-3dec427b22b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:14,bridge_name='br-int',has_traffic_filtering=True,id=696f6fc7-bb8a-473c-afba-3dec427b22b7,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696f6fc7-bb') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_vif [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:14,bridge_name='br-int',has_traffic_filtering=True,id=696f6fc7-bb8a-473c-afba-3dec427b22b7,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696f6fc7-bb') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap696f6fc7-bb, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:30 user nova-compute[73144]: INFO os_vif [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:14,bridge_name='br-int',has_traffic_filtering=True,id=696f6fc7-bb8a-473c-afba-3dec427b22b7,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696f6fc7-bb')
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WpcGMzXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:19:30 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac954248-03e4-49c1-bf75-671534b6d290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating instance_info_cache with network_info: [{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26f7269-3bcc-4b5f-920e-e6a83ac77382]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:30 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:30 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:19:30 user nova-compute[73144]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 (non-flash)
Aug 14 22:19:30 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:19:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1584bfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58'): ({'sdd'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Removing single pathed devices sdd {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c963d0-0196-46d7-aa1d-b3cc29135e48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[578c95b2-9509-4703-91ae-99c078c8b251]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flushing IO for device /dev/sdd {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e90fac-5883-4dc1-a2e6-a8eb12acd3b7]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec66d4-92bb-412d-848e-80ebbc7acb63]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] SCSI volumes sdd have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce0dfa4-f46c-4833-a5cb-6aec648dfb9b]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ab38e-126a-42f0-af11-e1b0e9c31833]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260]
Aug 14 22:19:30 user nova-compute[73144]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58, portal: 172.16.0.220,3260] successful.
Aug 14 22:19:30 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b495aafa-a74c-4775-b200-31ad74b11b58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b638fcc8-24be-4164-94d7-7ec7c0a65226]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== disconnect_volume: return (308ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:19:30 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Deleting instance files /opt/stack/data/nova/instances/7e4c3bea-d31a-42d6-b499-60194be3b01d_del
Aug 14 22:19:30 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Deletion of /opt/stack/data/nova/instances/7e4c3bea-d31a-42d6-b499-60194be3b01d_del complete
Aug 14 22:19:30 user nova-compute[73144]: INFO nova.compute.manager [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 14 22:19:30 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:19:30 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-39630d1c-b84f-47de-8af5-18ffb4d6100a req-2843ba04-9dfa-4734-ab00-6c118555fced service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-vif-deleted-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:19:31 user nova-compute[73144]: INFO nova.compute.manager [req-39630d1c-b84f-47de-8af5-18ffb4d6100a req-2843ba04-9dfa-4734-ab00-6c118555fced service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Neutron deleted interface 696f6fc7-bb8a-473c-afba-3dec427b22b7; detaching it from the instance and deleting it from the info cache
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.network.neutron [req-39630d1c-b84f-47de-8af5-18ffb4d6100a req-2843ba04-9dfa-4734-ab00-6c118555fced service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:19:31 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Took 0.59 seconds to deallocate network for instance.
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-39630d1c-b84f-47de-8af5-18ffb4d6100a req-2843ba04-9dfa-4734-ab00-6c118555fced service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Detach interface failed, port_id=696f6fc7-bb8a-473c-afba-3dec427b22b7, reason: Instance 7e4c3bea-d31a-42d6-b499-60194be3b01d could not be found. {{(pid=73144) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-vif-unplugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] Acquiring lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] No waiting events found dispatching network-vif-unplugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-vif-unplugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received event network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] Acquiring lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] No waiting events found dispatching network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:19:31 user nova-compute[73144]: WARNING nova.compute.manager [req-d99759b1-87d4-4688-a966-b7b94aa9060a req-294b69fb-bc15-4ce7-ad3b-5f5aa55d03cc service nova] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Received unexpected event network-vif-plugged-696f6fc7-bb8a-473c-afba-3dec427b22b7 for instance with vm_state active and task_state deleting.
Aug 14 22:19:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:32 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:35 user nova-compute[73144]: INFO nova.compute.manager [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Took 4.79 seconds to detach 1 volumes for instance.
Aug 14 22:19:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:19:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:19:36 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:19:36 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:19:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:36 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Deleted allocations for instance 7e4c3bea-d31a-42d6-b499-60194be3b01d
Aug 14 22:19:36 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-a42767f7-ea15-495e-930d-a0f71fa05950 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "7e4c3bea-d31a-42d6-b499-60194be3b01d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.962s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:19:38 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:19:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:45 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051570.1404862, 7e4c3bea-d31a-42d6-b499-60194be3b01d => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:19:45 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] VM Stopped (Lifecycle Event)
Aug 14 22:19:45 user nova-compute[73144]: DEBUG nova.compute.manager [None req-18981bdd-da02-4c3f-b182-6fab612222d1 None None] [instance: 7e4c3bea-d31a-42d6-b499-60194be3b01d] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:19:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:19:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:19:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:19:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:19:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:48 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:19:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:09 user nova-compute[73144]: INFO nova.compute.manager [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Detaching volume 5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba
Aug 14 22:20:09 user nova-compute[73144]: INFO nova.virt.block_device [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Attempting to driver detach volume 5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba from mountpoint /dev/vdb
Aug 14 22:20:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Attempting to detach device vdb from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the persistent domain config. {{(pid=73144) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:20:09 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:20:09 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 22:20:09 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:20:09 user nova-compute[73144]:   <serial>5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba</serial>
Aug 14 22:20:09 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:20:09 user nova-compute[73144]: </disk>
Aug 14 22:20:09 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:20:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Successfully detached device vdb from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the persistent domain config.
Aug 14 22:20:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the live domain config. {{(pid=73144) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.guest [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:20:09 user nova-compute[73144]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:20:09 user nova-compute[73144]:   <source dev="/dev/sdc"/>
Aug 14 22:20:09 user nova-compute[73144]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:20:09 user nova-compute[73144]:   <serial>5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba</serial>
Aug 14 22:20:09 user nova-compute[73144]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:20:09 user nova-compute[73144]: </disk>
Aug 14 22:20:09 user nova-compute[73144]:  {{(pid=73144) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-9fb39481-608f-40c6-8914-a9c82b2896f8 None None] Received event <DeviceRemovedEvent: 1692051609.741126, 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73144) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:20:09 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Successfully detached device vdb from instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 from the live domain config.
Aug 14 22:20:09 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PELnlIUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:20:09 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4044b4-a78f-4abe-8bf9-ad035e032518]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5875974-4cac-4341-862c-15c69dbc409d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:20:09 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:20:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:20:09 user nova-compute[73144]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba (non-flash)
Aug 14 22:20:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1585c4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba'): ({'sdc'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Removing single pathed devices sdc {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a262c3-ba59-4266-8ce4-4d7fbc423f94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8f9fe6-c8d1-4f7b-8209-14f000f9e53f]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Flushing IO for device /dev/sdc {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a3d317-d498-41fc-a15e-54cd5e286c19]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af22853-e738-4526-a6a6-3fe6e54dea82]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] SCSI volumes sdc have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a2ccc-b9a8-46c8-b49f-7e93fb8b55bc]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f567301a-9d68-49b9-bf68-0a68f266e23e]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260]
Aug 14 22:20:09 user nova-compute[73144]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba, portal: 172.16.0.220,3260] successful.
Aug 14 22:20:09 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:20:09 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5738b7e6-5a9f-4125-a3c1-20ecdb2e99ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3e6c4e-0e6c-4de7-9141-66cdba8dd829]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] <== disconnect_volume: return (271ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG nova.objects.instance [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'flavor' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:20:10 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-b96bbf51-3bca-4269-a7d0-4e4236760efe tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:16 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:24 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:25 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73144) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:20:26 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:20:26 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=25.093521118164062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance cc85ca71-e7ac-4790-83b2-0887c3cab074 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73144) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:20:26 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-changed-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Refreshing instance network info cache due to event network-changed-e8affea4-0e1c-461e-a393-79501753bd30. {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] Acquiring lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] Acquired lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.network.neutron [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Refreshing network info cache for port e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "cc85ca71-e7ac-4790-83b2-0887c3cab074" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:31 user nova-compute[73144]: INFO nova.compute.manager [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Terminating instance
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquired lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Forcefully refreshing network info cache for instance {{(pid=73144) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-10ee2256-8714-4eea-938c-455b80e0e375 req-b751a384-9520-4e81-98e8-d14acc9a6a90 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-vif-unplugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10ee2256-8714-4eea-938c-455b80e0e375 req-b751a384-9520-4e81-98e8-d14acc9a6a90 service nova] Acquiring lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10ee2256-8714-4eea-938c-455b80e0e375 req-b751a384-9520-4e81-98e8-d14acc9a6a90 service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10ee2256-8714-4eea-938c-455b80e0e375 req-b751a384-9520-4e81-98e8-d14acc9a6a90 service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-10ee2256-8714-4eea-938c-455b80e0e375 req-b751a384-9520-4e81-98e8-d14acc9a6a90 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] No waiting events found dispatching network-vif-unplugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:20:31 user nova-compute[73144]: DEBUG nova.compute.manager [req-10ee2256-8714-4eea-938c-455b80e0e375 req-b751a384-9520-4e81-98e8-d14acc9a6a90 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-vif-unplugged-e8affea4-0e1c-461e-a393-79501753bd30 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.network.neutron [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updated VIF entry in instance network info cache for port e8affea4-0e1c-461e-a393-79501753bd30. {{(pid=73144) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.network.neutron [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating instance_info_cache with network_info: [{"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-f958ec98-33cb-4052-840f-31c844d06ab7 req-2f6914dc-1b9f-4f71-8527-da3150356906 service nova] Releasing lock "refresh_cache-cc85ca71-e7ac-4790-83b2-0887c3cab074" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:20:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Instance destroyed successfully.
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.objects.instance [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lazy-loading 'resources' on Instance uuid cc85ca71-e7ac-4790-83b2-0887c3cab074 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-9538474',display_name='tempest-TestVolumeBootPattern-server-9538474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-9538474',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4hNGhGgU0tJyePhibgBbWHkvAY4Wccg3iMtvibzst+EbTuU2TkRXTCXVPaRNIVVJKIiumwBsd7eK+rCP3V/4Z/ICaU8T+CbCOm1e898wxs4mdC41pOrXkZKsOJJMTUMw==',key_name='tempest-TestVolumeBootPattern-420785446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f796a65843b467a9889f47789c87eed',ramdisk_id='',reservation_id='r-tarjcf2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-790116957',owner_user_name='tempest-TestVolumeBootPattern-790116957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:15:46Z,user_data=None,user_id='52a3e93f724b43a08ee42b79c63ed4d0',uuid=cc85ca71-e7ac-4790-83b2-0887c3cab074,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converting VIF {"id": "e8affea4-0e1c-461e-a393-79501753bd30", "address": "fa:16:3e:d1:61:f4", "network": {"id": "58ab6d42-37ad-4900-9cde-6efc103ab1a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-81814550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f796a65843b467a9889f47789c87eed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8affea4-0e", "ovs_interfaceid": "e8affea4-0e1c-461e-a393-79501753bd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:61:f4,bridge_name='br-int',has_traffic_filtering=True,id=e8affea4-0e1c-461e-a393-79501753bd30,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8affea4-0e') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_vif [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:61:f4,bridge_name='br-int',has_traffic_filtering=True,id=e8affea4-0e1c-461e-a393-79501753bd30,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8affea4-0e') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8affea4-0e, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:32 user nova-compute[73144]: INFO os_vif [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:61:f4,bridge_name='br-int',has_traffic_filtering=True,id=e8affea4-0e1c-461e-a393-79501753bd30,network=Network(58ab6d42-37ad-4900-9cde-6efc103ab1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8affea4-0e')
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] calling os-brick to detach iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa1784827d0>, {'target_iqns': ['iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSGgPmyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:20:32 user nova-compute[73144]: WARNING os_brick.initiator.connectors.base [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff', 0)] {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[280fefd2-4424-492a-9e57-7ebc94fce56d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[60168bbd-4798-481e-a13c-72d1718df9ab]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:20:32 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff (non-flash)
Aug 14 22:20:32 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa1583ef5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff'): ({'sdb'}, set())}) {{(pid=73144) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Removing single pathed devices sdb {{(pid=73144) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.network.neutron [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updating instance_info_cache with network_info: [{"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Releasing lock "refresh_cache-9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" {{(pid=73144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updated the network info_cache for instance {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2559c8-4786-461e-ba2d-0ea0ddcf3616]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71f8f9-1dad-4ded-ad83-60a2bb2e0340]: (4, ('ok\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Flushing IO for device /dev/sdb {{(pid=73144) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c26f4c-025e-4cb3-937e-35f3ea632c98]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73144) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1124c-0a54-47c3-b8a5-41132c58f851]: (4, ('1', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.linuxscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] SCSI volumes sdb have been removed. {{(pid=73144) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff')] {{(pid=73144) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cea9f2-246e-4e0d-a69b-a2062035e846]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --logout {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f573c-d7ba-4413-af4a-999074f3ea8c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260]
Aug 14 22:20:32 user nova-compute[73144]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff, portal: 172.16.0.220,3260] successful.
Aug 14 22:20:32 user nova-compute[73144]:  stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op delete {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:078af43c-80ec-4edd-836f-657c7718a7ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e501c4d-dddf-4220-b50a-82f94c5654dd]: (4, ('', '')) {{(pid=84572) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73144) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.base [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] <== disconnect_volume: return (259ms) None {{(pid=73144) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Disconnected iSCSI Volume {{(pid=73144) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:20:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Deleting instance files /opt/stack/data/nova/instances/cc85ca71-e7ac-4790-83b2-0887c3cab074_del
Aug 14 22:20:32 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Deletion of /opt/stack/data/nova/instances/cc85ca71-e7ac-4790-83b2-0887c3cab074_del complete
Aug 14 22:20:32 user nova-compute[73144]: INFO nova.compute.manager [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 14 22:20:32 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:20:32 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:20:33 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:20:33 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Took 0.58 seconds to deallocate network for instance.
Aug 14 22:20:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-2a947326-8caf-4986-9edd-3601d8a35f60 req-4f3edf63-b703-48ce-ac60-46aa243bb92c service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-vif-deleted-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:20:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-decf1e86-76ee-4047-8d9b-dab900410ed4 req-54904321-f783-4c5c-ac82-192bff726aed service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received event network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:20:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-decf1e86-76ee-4047-8d9b-dab900410ed4 req-54904321-f783-4c5c-ac82-192bff726aed service nova] Acquiring lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-decf1e86-76ee-4047-8d9b-dab900410ed4 req-54904321-f783-4c5c-ac82-192bff726aed service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:33 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-decf1e86-76ee-4047-8d9b-dab900410ed4 req-54904321-f783-4c5c-ac82-192bff726aed service nova] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:33 user nova-compute[73144]: DEBUG nova.compute.manager [req-decf1e86-76ee-4047-8d9b-dab900410ed4 req-54904321-f783-4c5c-ac82-192bff726aed service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] No waiting events found dispatching network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:20:33 user nova-compute[73144]: WARNING nova.compute.manager [req-decf1e86-76ee-4047-8d9b-dab900410ed4 req-54904321-f783-4c5c-ac82-192bff726aed service nova] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Received unexpected event network-vif-plugged-e8affea4-0e1c-461e-a393-79501753bd30 for instance with vm_state active and task_state deleting.
Aug 14 22:20:34 user nova-compute[73144]: INFO nova.compute.manager [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Took 0.78 seconds to detach 1 volumes for instance.
Aug 14 22:20:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:34 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:20:34 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:20:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:34 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Deleted allocations for instance cc85ca71-e7ac-4790-83b2-0887c3cab074
Aug 14 22:20:34 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-ce7cd715-5a85-4484-be0a-fed7683ed481 tempest-TestVolumeBootPattern-790116957 tempest-TestVolumeBootPattern-790116957-project-member] Lock "cc85ca71-e7ac-4790-83b2-0887c3cab074" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.963s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:37 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:20:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:20:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:20:42 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:47 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051632.290678, cc85ca71-e7ac-4790-83b2-0887c3cab074 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:20:47 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] VM Stopped (Lifecycle Event)
Aug 14 22:20:47 user nova-compute[73144]: DEBUG nova.compute.manager [None req-36ba6ef1-87c3-4152-83ea-5d7a27534f59 None None] [instance: cc85ca71-e7ac-4790-83b2-0887c3cab074] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:20:47 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.003s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Verify base images {{(pid=73144) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Image id 53539290-1600-4e84-8f24-496f41396a43 yields fingerprint a36c4e90e60aaf420d41b29299ad8df91fccb3a9 {{(pid=73144) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] image 53539290-1600-4e84-8f24-496f41396a43 at (/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9): checking
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] image 53539290-1600-4e84-8f24-496f41396a43 at (/opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9): image is in use {{(pid=73144) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73144) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 is a valid instance name {{(pid=73144) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 has a disk file {{(pid=73144) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG oslo_concurrency.processutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73144) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 is backed by a36c4e90e60aaf420d41b29299ad8df91fccb3a9 {{(pid=73144) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad
Aug 14 22:20:48 user nova-compute[73144]: WARNING nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Active base files: /opt/stack/data/nova/instances/_base/a36c4e90e60aaf420d41b29299ad8df91fccb3a9
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Removable base files: /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593 /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193 /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20 /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1 /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a91c83a23022c5867fc15cfd177b9ef045b18d2e
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7191dcfc84b245de8d61fc94ef3d7fecf1520b5a
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6ef90e99efe509c3d8782c43e184dc4313ab9593
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/62d002efaff3e9feb01a6f38e0ae2fa3d792f21a
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5601f5b4019f7bdbbe50f23ab6eb37e8f091b193
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a2231bdb465b22c943a5dfd7a74020acc1036d20
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/656c7d6c5cd467600ec723f03e7d2656e16a06e1
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b9bbb1d261c8f41a2357736d5eb223d7399856ad
Aug 14 22:20:48 user nova-compute[73144]: INFO nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b5beb6fde0cc167225f4c9608a4b22dae862b25e
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Verification complete {{(pid=73144) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Verify swap images {{(pid=73144) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 22:20:48 user nova-compute[73144]: DEBUG nova.virt.libvirt.imagecache [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Verify ephemeral images {{(pid=73144) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 22:20:52 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:20:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:20:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:20:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:20:57 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:59 user nova-compute[73144]: INFO nova.compute.manager [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Terminating instance
Aug 14 22:20:59 user nova-compute[73144]: DEBUG nova.compute.manager [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Start destroying the instance on the hypervisor. {{(pid=73144) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6c8d0b0-c399-4f51-b8b1-fb80522a0c7b req-a9699156-f76d-4a8a-a4ba-8a9de972ebc0 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-vif-unplugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6c8d0b0-c399-4f51-b8b1-fb80522a0c7b req-a9699156-f76d-4a8a-a4ba-8a9de972ebc0 service nova] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6c8d0b0-c399-4f51-b8b1-fb80522a0c7b req-a9699156-f76d-4a8a-a4ba-8a9de972ebc0 service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-a6c8d0b0-c399-4f51-b8b1-fb80522a0c7b req-a9699156-f76d-4a8a-a4ba-8a9de972ebc0 service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6c8d0b0-c399-4f51-b8b1-fb80522a0c7b req-a9699156-f76d-4a8a-a4ba-8a9de972ebc0 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] No waiting events found dispatching network-vif-unplugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:20:59 user nova-compute[73144]: DEBUG nova.compute.manager [req-a6c8d0b0-c399-4f51-b8b1-fb80522a0c7b req-a9699156-f76d-4a8a-a4ba-8a9de972ebc0 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-vif-unplugged-13ecf857-d666-4057-8c33-9479a275b130 for instance with task_state deleting. {{(pid=73144) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:21:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [-] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Instance destroyed successfully.
Aug 14 22:21:00 user nova-compute[73144]: DEBUG nova.objects.instance [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lazy-loading 'resources' on Instance uuid 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 {{(pid=73144) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG nova.virt.libvirt.vif [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-90100856',display_name='tempest-TestServerVolumeAttachmentScenario-server-90100856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-90100856',id=51,image_ref='53539290-1600-4e84-8f24-496f41396a43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKV00mjwiTZCY2BedIsJm8vxuE3OkVeIwI0NVFdFSiUzqJnuIqckFPNwO5JvR18rxFQ9uCoJofdl12SmeYI/iRJlH/Qup2v6VpguQnl/35AP8xQzjFaXYH7FbKFUEu0OA==',key_name='tempest-keypair-557299368',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:17:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73a97840b7634f8d96887fd9ace7c80e',ramdisk_id='',reservation_id='r-gtq5wes9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='53539290-1600-4e84-8f24-496f41396a43',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-535491581',owner_user_name='tempest-TestServerVolumeAttachmentScenario-535491581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9798a44901ed49b592851aa91f15de1b',uuid=9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Converting VIF {"id": "13ecf857-d666-4057-8c33-9479a275b130", "address": "fa:16:3e:96:62:da", "network": {"id": "f961ab13-f798-4dec-a64f-b7eed3145036", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1308562396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a97840b7634f8d96887fd9ace7c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ecf857-d6", "ovs_interfaceid": "13ecf857-d666-4057-8c33-9479a275b130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG nova.network.os_vif_util [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:62:da,bridge_name='br-int',has_traffic_filtering=True,id=13ecf857-d666-4057-8c33-9479a275b130,network=Network(f961ab13-f798-4dec-a64f-b7eed3145036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ecf857-d6') {{(pid=73144) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG os_vif [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:62:da,bridge_name='br-int',has_traffic_filtering=True,id=13ecf857-d666-4057-8c33-9479a275b130,network=Network(f961ab13-f798-4dec-a64f-b7eed3145036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ecf857-d6') {{(pid=73144) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13ecf857-d6, bridge=br-int, if_exists=True) {{(pid=73144) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:21:00 user nova-compute[73144]: INFO os_vif [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:62:da,bridge_name='br-int',has_traffic_filtering=True,id=13ecf857-d666-4057-8c33-9479a275b130,network=Network(f961ab13-f798-4dec-a64f-b7eed3145036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ecf857-d6')
Aug 14 22:21:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Deleting instance files /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984_del
Aug 14 22:21:00 user nova-compute[73144]: INFO nova.virt.libvirt.driver [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Deletion of /opt/stack/data/nova/instances/9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984_del complete
Aug 14 22:21:00 user nova-compute[73144]: INFO nova.compute.manager [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 22:21:00 user nova-compute[73144]: DEBUG oslo.service.loopingcall [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73144) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG nova.compute.manager [-] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Deallocating network for instance {{(pid=73144) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:21:00 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] deallocate_for_instance() {{(pid=73144) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG nova.network.neutron [-] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Updating instance_info_cache with network_info: [] {{(pid=73144) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:21:01 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Took 1.06 seconds to deallocate network for instance.
Aug 14 22:21:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-3f001c40-373c-4cc7-9242-16d92a232ad5 req-7aa452e8-d74a-4311-88a4-eeb1f8777184 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-vif-deleted-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:21:01 user nova-compute[73144]: INFO nova.scheduler.client.report [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Deleted allocations for instance 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984
Aug 14 22:21:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-e1adfc1c-8001-4354-9d46-cd73284a72b5 tempest-TestServerVolumeAttachmentScenario-535491581 tempest-TestServerVolumeAttachmentScenario-535491581-project-member] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-10c3649f-c771-4371-8e40-cc20cd84ebfc req-6e9631fe-c0c8-40e0-8c4c-ef022ab4fe34 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received event network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10c3649f-c771-4371-8e40-cc20cd84ebfc req-6e9631fe-c0c8-40e0-8c4c-ef022ab4fe34 service nova] Acquiring lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10c3649f-c771-4371-8e40-cc20cd84ebfc req-6e9631fe-c0c8-40e0-8c4c-ef022ab4fe34 service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [req-10c3649f-c771-4371-8e40-cc20cd84ebfc req-6e9631fe-c0c8-40e0-8c4c-ef022ab4fe34 service nova] Lock "9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:21:01 user nova-compute[73144]: DEBUG nova.compute.manager [req-10c3649f-c771-4371-8e40-cc20cd84ebfc req-6e9631fe-c0c8-40e0-8c4c-ef022ab4fe34 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] No waiting events found dispatching network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 {{(pid=73144) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:21:01 user nova-compute[73144]: WARNING nova.compute.manager [req-10c3649f-c771-4371-8e40-cc20cd84ebfc req-6e9631fe-c0c8-40e0-8c4c-ef022ab4fe34 service nova] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Received unexpected event network-vif-plugged-13ecf857-d666-4057-8c33-9479a275b130 for instance with vm_state deleted and task_state None.
Aug 14 22:21:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:21:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:21:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:21:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:21:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:15 user nova-compute[73144]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692051660.3699827, 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984 => Stopped> {{(pid=73144) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:21:15 user nova-compute[73144]: INFO nova.compute.manager [-] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] VM Stopped (Lifecycle Event)
Aug 14 22:21:15 user nova-compute[73144]: DEBUG nova.compute.manager [None req-b28bb501-a7d8-49e2-8a38-a6b2e0c28d85 None None] [instance: 9d84ee4e-4a7a-4dd6-a4b5-ee8283cac984] Checking state {{(pid=73144) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:21:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:21:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:22 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:22 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:25 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:27 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:21:27 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:21:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:21:27 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:21:27 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:21:28 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:21:28 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=25.120361328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing inventories for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating ProviderTree inventory for provider fcca1cea-a902-4b33-85fb-860d4db9f73e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Updating inventory in ProviderTree for provider fcca1cea-a902-4b33-85fb-860d4db9f73e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing aggregate associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, aggregates: None {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Refreshing trait associations for resource provider fcca1cea-a902-4b33-85fb-860d4db9f73e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI {{(pid=73144) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:21:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:29 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:31 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Starting heal instance info cache {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:21:31 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Didn't find any instances for network info cache update. {{(pid=73144) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 22:21:32 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:32 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73144) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 22:21:33 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:34 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:35 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:38 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:40 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:41 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Cleaning up deleted instances {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 22:21:41 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] There are 0 instances to clean {{(pid=73144) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 22:21:43 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:21:45 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:21:50 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:21:55 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:22:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:22:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:22:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:22:00 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:05 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:08 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:10 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:22:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73144) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 22:22:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:22:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73144) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:22:15 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:20 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:23 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:22:25 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:22:26 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Auditing locally available compute resources for user (node: user) {{(pid=73144) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:22:28 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:22:28 user nova-compute[73144]: WARNING nova.virt.libvirt.driver [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:22:28 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=25.08487319946289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73144) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:22:28 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:22:29 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:22:29 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73144) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:22:29 user nova-compute[73144]: DEBUG nova.compute.provider_tree [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed in ProviderTree for provider: fcca1cea-a902-4b33-85fb-860d4db9f73e {{(pid=73144) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:22:29 user nova-compute[73144]: DEBUG nova.scheduler.client.report [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Inventory has not changed for provider fcca1cea-a902-4b33-85fb-860d4db9f73e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73144) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:22:29 user nova-compute[73144]: DEBUG nova.compute.resource_tracker [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Compute_service record updated for user:user {{(pid=73144) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:22:29 user nova-compute[73144]: DEBUG oslo_concurrency.lockutils [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=73144) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:22:30 user nova-compute[73144]: DEBUG oslo_service.periodic_task [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73144) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:22:30 user nova-compute[73144]: DEBUG nova.compute.manager [None req-f8237494-2ceb-41f3-b6d4-004f6d740e93 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73144) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:22:30 user nova-compute[73144]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73144) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}